-- Logs begin at Wed 2022-08-24 04:08:05 UTC, end at Wed 2022-08-24 05:15:57 UTC. -- Aug 24 04:38:56.743403 dv-cinder-854266-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 04:38:56.757170 dv-cinder-854266-1-smb devstack@keystone.service[81479]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 04:38:56 2022] *** Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: nodename: dv-cinder-854266-1-smb Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: machine: x86_64 Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: clock source: unix Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: pcre jit disabled Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: detected number of CPU cores: 4 Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: current working directory: / Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: detected binary path: /usr/bin/uwsgi-core Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: your processes number limit is 47680 Aug 24 04:38:56.759209 dv-cinder-854266-1-smb devstack@keystone.service[81479]: your memory page size is 4096 bytes Aug 24 04:38:56.760104 dv-cinder-854266-1-smb devstack@keystone.service[81479]: detected max file descriptor number: 2048 Aug 24 04:38:56.760104 dv-cinder-854266-1-smb devstack@keystone.service[81479]: lock engine: pthread robust mutexes Aug 24 04:38:56.760104 dv-cinder-854266-1-smb devstack@keystone.service[81479]: thunder lock: enabled Aug 24 04:38:56.760104 dv-cinder-854266-1-smb devstack@keystone.service[81479]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 04:38:56.760104 dv-cinder-854266-1-smb devstack@keystone.service[81479]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 04:38:56.799337 dv-cinder-854266-1-smb devstack@keystone.service[81479]: Python main interpreter initialized at 0x55901e7bc9c0 Aug 24 04:38:56.799337 dv-cinder-854266-1-smb devstack@keystone.service[81479]: python threads support enabled Aug 24 04:38:56.799337 dv-cinder-854266-1-smb devstack@keystone.service[81479]: your server socket listen backlog is limited to 100 connections Aug 24 04:38:56.799337 dv-cinder-854266-1-smb devstack@keystone.service[81479]: your mercy for graceful operations on workers is 90 seconds Aug 24 04:38:56.799745 dv-cinder-854266-1-smb devstack@keystone.service[81479]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 04:38:56.799818 dv-cinder-854266-1-smb devstack@keystone.service[81479]: *** Operational MODE: preforking *** Aug 24 04:38:56.800051 dv-cinder-854266-1-smb devstack@keystone.service[81479]: *** uWSGI is running in multiple interpreter mode *** Aug 24 04:38:56.800051 dv-cinder-854266-1-smb devstack@keystone.service[81479]: spawned uWSGI master process (pid: 81479) Aug 24 04:38:56.800258 dv-cinder-854266-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 04:38:56.801806 dv-cinder-854266-1-smb devstack@keystone.service[81479]: spawned uWSGI worker 1 (pid: 81490, cores: 1) Aug 24 04:38:56.801806 dv-cinder-854266-1-smb devstack@keystone.service[81479]: spawned uWSGI worker 2 (pid: 81491, cores: 1) Aug 24 04:38:56.801806 dv-cinder-854266-1-smb devstack@keystone.service[81479]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 04:39:01.207365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:01.207365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: from cryptography.utils import int_from_bytes Aug 24 04:39:01.208231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:01.208231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: from cryptography.utils import int_from_bytes Aug 24 04:39:01.209691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:01.209691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: from cryptography.utils import int_from_bytes Aug 24 04:39:01.210220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 04:39:01.210220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: from cryptography.utils import int_from_bytes Aug 24 04:39:01.260084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:39:01.260807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:39:01.260965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] command line args: [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:39:01.261243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:39:01.261422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ================================================================================ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:39:01.261679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] admin_token = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.261928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_dir = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.262116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.262299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] config_source = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.262478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] debug = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.262678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.263053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.263235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.263424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 04:39:01.263556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.263707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 04:39:01.263824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.263932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] command line args: [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 04:39:01.264026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 04:39:01.264222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_config_append = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ================================================================================ {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 04:39:01.264431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_dir = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] admin_token = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] config_dir = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.264923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] config_source = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] debug = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.265929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_config_append = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.266989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_dir = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_file = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.267834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] publish_errors = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.268944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.269843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] standard_threads = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.270833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_journal = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_json = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_stderr = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] publish_errors = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] use_syslog = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.271898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.272080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.272165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.272263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.272346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.272498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] standard_threads = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.272575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.272727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.272806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.272967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.273150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.273312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] use_journal = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.273527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] use_json = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] use_stderr = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.273842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] use_syslog = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.273925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 04:39:01.274184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.274938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.275939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.276943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.277915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.278858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.279847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.280964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.281966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.282909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.283855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.284953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.285984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.286961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.287950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.288915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.289971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.290892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.291056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.291772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.291848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.292949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.293834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.294988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.295948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.296976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.external = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.297885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.password = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] auth.token = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.298959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.299899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.300967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.external = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.301994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.password = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] auth.token = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.302963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.303904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.304881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.305927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.306902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.307627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.307758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.307758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.307968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.308084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.308295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.308521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.308686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.308860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.309924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.310893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.311881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.312956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.313954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.314933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.315885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.316861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.317972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.318946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.319848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.320889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.321857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.322970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.323969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.324964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.325986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.326869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.327972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.328995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.329900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.330983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.331991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.332941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.333955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.334978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.335905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.336910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.337891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.338896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] role.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] role.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.339977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.340839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.341872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.342876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.343869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.344906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.345991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.346945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.347906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.348970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.349897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.350952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.351960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.352916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.connection = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.353556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.354265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.354373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.354595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.354751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.354886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.355022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81491) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:39:01.355151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.355556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.355815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.355977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.356218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.356496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.356782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.357129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.357376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.357516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.357775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.358516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.358516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.358692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.358797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.359034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 04:39:01.359204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81490) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 04:39:01.387802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.388032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.388197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.388284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.388475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.388591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.397699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.398682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.428556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.428795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.429147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.429526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.487450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.488553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.537932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.538213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.539844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.540097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.698681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.698888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.699117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.699339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.699588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.699806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.699940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.700177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.700402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.700620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.700835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.701055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.723630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.723885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.724927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.725089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.725482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.725879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.736965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.737347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.750485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.750685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.750775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.750919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81490) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.751890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.752016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81491) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 04:39:01.769443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.769654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:39:01.769990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.770079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.770188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:39:01.770269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:39:01.770466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.770558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.770732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 04:39:01.770873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.771019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.771240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.771323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.771527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.771818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.772086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.781990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.782072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.782280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.788934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.789234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.792138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.792240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.792417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.792515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.792703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.792786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.792989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.793880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.794819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.795002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.795080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.818194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.818348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.819968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.820108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.820251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.820393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.825654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.825941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.826070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.826228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.826358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.826643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.832601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.832891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.832973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.833258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.836988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.837285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.837568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.837675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.837857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.837952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.838988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.839068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.839329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.839631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.839903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.856361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.856645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.857420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.857702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.860537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.861582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.863792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.864087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.864787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.865096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.868296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.869821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.872032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.873275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.875269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.875605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.875898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.876184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.876463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.876546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.876764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.876867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.877084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.877372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.877653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.877946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.893088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.893381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.893648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.893912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.894617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.894917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.895187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.895450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.900843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.902389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.902664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.902745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.904295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.904569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.905339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.905628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.905926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.906213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.906490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.907184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.907485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.907783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.908074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.908351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.917850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.918199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.918414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.918700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.918978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.919258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.919561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.920161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.920443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.920719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.920995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.921274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.921548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.921832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.935537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.938284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.938577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.941326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.941492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.942941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.944484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.944707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.944994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.945297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.945905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.947436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.948417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.948892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.952536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.953993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.955349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.956827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.956912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.957192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.957482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.957769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.959812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.960104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.960389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.960676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.965848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.966144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.966428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.968996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.969287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.969570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.973317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81491) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.973608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.973893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.974172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.974456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.974740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.975018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.975287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.975592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.975884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.976170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.976436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81490) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 04:39:01.976520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.976707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.976787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.976969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81491) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.977050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.977251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.977533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.977803 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.978074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.978378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.978728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.979186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.979675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.979961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.980230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:01.980491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81490) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 04:39:02.016274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55901e7bc9c0 pid: 81490 (default app) Aug 24 04:39:02.016437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55901e7bc9c0 pid: 81491 (default app) Aug 24 04:39:02.019907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a987-39b5-48b7-bf5e-9c738f4094ff None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:02.020194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a987-39b5-48b7-bf5e-9c738f4094ff None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:02.020489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9507a987-39b5-48b7-bf5e-9c738f4094ff None None] PATH_INFO: `/v3` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:02.024676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 791 bytes} [Wed Aug 24 04:39:02 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:08.854924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.855451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.855451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.859821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1/2] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:08.867363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:08.867897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:08.868038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:08.939321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: INFO dbcounter [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] Registered counter for database keystone Aug 24 04:39:08.959723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG oslo_db.sqlalchemy.engines [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81490) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:08.966858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writer thread running {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:09.162176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG passlib.handlers.bcrypt [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81490) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:39:09.162508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG passlib.handlers.bcrypt [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81490) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:39:09.219762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:09.221404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:09.361863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 2/3] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 04:39:09.830395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:09.902575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: INFO dbcounter [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] Registered counter for database keystone Aug 24 04:39:09.926093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG oslo_db.sqlalchemy.engines [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81491) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 04:39:09.933384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writer thread running {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 04:39:10.064692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf27c6-0df2-470e-a619-78f529357bbc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.069490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.070213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.070547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.070820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.080128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.133312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING keystone.common.rbac_enforcer.enforcer [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:39:10.133574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a7c5-6ccf-450a-a66c-20286dc47390 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.144502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 2/4] 10.222.0.85 () {58 vars in 1324 bytes} [Wed Aug 24 04:39:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:39:10.151204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:10.167764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a6dcfb-a41d-4377-bcb0-23f841094f2c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:10.172355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:10.173501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:10.173808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:10.174081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] PATH_INFO: `/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:10.175764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] RBAC: Authorizing `identity:get_project(project_id=aa9562368e9a4def85d52ce0d60bc9dc)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:10.231032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 04:39:10.231365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c226e1-e55b-4b38-896a-f4cffb4d02e7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:10.236116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 3/5] 10.222.0.85 () {56 vars in 1207 bytes} [Wed Aug 24 04:39:10 2022] GET /identity/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:12.204577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d292-0aeb-4f8b-968d-a2db15f450a9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.205131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d292-0aeb-4f8b-968d-a2db15f450a9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.205131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44d292-0aeb-4f8b-968d-a2db15f450a9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.209519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 3/6] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:12.216035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.216526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.216614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.237558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:12.239505 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:12.251168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 4/7] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 04:39:12.535008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d292-0aeb-4f8b-968d-a2db15f450a9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:12.555380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44d292-0aeb-4f8b-968d-a2db15f450a9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:12.560868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:12.561492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.561776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.562054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.570931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:12.572908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e055d6-7d95-4682-b424-95fd1e8ad455 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:12.582459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 4/8] 10.222.0.85 () {58 vars in 1324 bytes} [Wed Aug 24 04:39:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:39:12.588596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:12.597997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53262f30-cb74-4014-9113-5abfb6ea30f4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:12.602345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:12.603572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:12.603861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:12.604131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:12.605462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:12.607308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea402822-e241-4c94-bab5-05806fecb976 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:12.608918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 5/9] 10.222.0.85 () {56 vars in 1198 bytes} [Wed Aug 24 04:39:12 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:14.679100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993fdc-2fdf-46aa-bf04-3a0a4e2a4a33 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:14.679669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993fdc-2fdf-46aa-bf04-3a0a4e2a4a33 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:14.679766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993fdc-2fdf-46aa-bf04-3a0a4e2a4a33 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:14.682469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 5/10] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:14.689458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:14.689979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:14.690074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:14.708857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc88bd-ef4c-4e1c-b386-786c6967a49d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:14.709299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc88bd-ef4c-4e1c-b386-786c6967a49d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:14.709748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc88bd-ef4c-4e1c-b386-786c6967a49d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:14.711201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:14.712029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 6/11] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:14.713265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:14.721179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:14.721630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:14.722079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:14.794573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG passlib.handlers.bcrypt [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81491) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 04:39:14.794985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG passlib.handlers.bcrypt [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81491) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 04:39:14.833384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 6/12] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:14.841555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:14.843195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:14.957145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 7/13] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:15.112232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.139827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.230911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.233199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594a4e4-b4da-4baa-93c1-e563c180db06 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.270489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.271443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.271761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.272036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.285437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:15.295222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:15.296306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:15.297147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 7/14] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:15.302347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.347609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97fc07-d3a8-4b7e-8eac-ccd9550a9a74 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.350209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.390622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.391404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.391733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.392014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.400949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.421402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7497a-ca8a-455c-a5e1-378e8ff1710b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.458806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.459428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.459747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.460022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.460709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:15.461018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.463363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.468107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.469709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.476594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 8/15] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:15.483166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.584672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 8/16] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:39:15.591139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.594245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.596738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81649087-c363-4f2b-b005-446cb9094295 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.636798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.637434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.637718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.637983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.639135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.640697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.642208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 9/17] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:15.647793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.663930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.698814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2f8b-7f3a-44e8-a66b-a914b55a2836 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.737562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.738418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.738703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.738977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.758720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.760290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.763717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b88ed7-263a-4176-a967-85d44d760a56 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:15.779091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:15.780074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:15.781090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:15.781090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:15.781090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:15.781090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 9/18] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:15.786398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.800880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.801526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.801805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.802090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.803240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.804740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.807125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 10/19] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:15.813122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:15.854951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.903654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c306c-9245-43b6-8321-7128c10acd2d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.909107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:15.932431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10654d90-19f6-490e-992c-fd52c99e119a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:15.942378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.942998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.943573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.943853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.944497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:15.944795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.946181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3605c0-db6f-4d64-b555-a9b40017bee6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.970371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:15.970984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:15.971268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:15.971588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:15.972319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.domain.id=default, user.id=45426782369b4a9484d272e822de6396) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:15.972626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:15.974075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f389cc-bef6-4a87-b5c9-a94d96cefc2e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:15.976638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 10/20] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:15.982818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 11/21] 10.222.0.85 () {56 vars in 1322 bytes} [Wed Aug 24 04:39:15 2022] GET /identity/v3/role_assignments?user.id=45426782369b4a9484d272e822de6396&scope.domain.id=default&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:18.370545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb163-032e-48d3-927d-6c52c46dbde8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.371626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb163-032e-48d3-927d-6c52c46dbde8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.372128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cbb163-032e-48d3-927d-6c52c46dbde8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.374014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 11/22] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:18.379286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5250-df6f-4aec-b7a1-5b482489f236 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.379772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5250-df6f-4aec-b7a1-5b482489f236 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.379859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5250-df6f-4aec-b7a1-5b482489f236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.405822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5bcc5250-df6f-4aec-b7a1-5b482489f236 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:18.407036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5bcc5250-df6f-4aec-b7a1-5b482489f236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:18.525856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 12/23] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:18.529249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f0c7-21e5-4624-8e0e-597686c85e94 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.529824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f0c7-21e5-4624-8e0e-597686c85e94 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.530299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15f0c7-21e5-4624-8e0e-597686c85e94 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.536391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 12/24] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:18.542533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673913-eeee-4f16-a108-6b878fc79f50 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.542825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673913-eeee-4f16-a108-6b878fc79f50 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.543101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18673913-eeee-4f16-a108-6b878fc79f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.566657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-18673913-eeee-4f16-a108-6b878fc79f50 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:18.568166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-18673913-eeee-4f16-a108-6b878fc79f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:18.658917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 13/25] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:18.872544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cc96d-da8e-4770-ba1c-a1ddc14d93b2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.873286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cc96d-da8e-4770-ba1c-a1ddc14d93b2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.873858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228cc96d-da8e-4770-ba1c-a1ddc14d93b2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.875606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 13/26] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:18.881268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515cec0-106b-4aa7-9ae9-8da4a1494004 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:18.881548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515cec0-106b-4aa7-9ae9-8da4a1494004 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:18.882018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c515cec0-106b-4aa7-9ae9-8da4a1494004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:18.894403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:18.909152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c515cec0-106b-4aa7-9ae9-8da4a1494004 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:18.910296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c515cec0-106b-4aa7-9ae9-8da4a1494004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:18.999790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 14/27] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:19.010567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cc96d-da8e-4770-ba1c-a1ddc14d93b2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.054919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d730-bff1-4f30-8c08-b3c46322502e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.055222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d730-bff1-4f30-8c08-b3c46322502e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.055528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444d730-bff1-4f30-8c08-b3c46322502e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.057400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 15/28] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:19.064676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.065636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.066371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.100602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:19.102512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:19.252728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228cc96d-da8e-4770-ba1c-a1ddc14d93b2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.272031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 16/29] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:19.272903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.295002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:19.334264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.335675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.336408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.337116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.379089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:19.387378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:19.388306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:19.389037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:19.391526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 14/30] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:19.392576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.441633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:19.540510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5ac8d-985f-46e0-820e-2aced9a0fa02 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.611564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9136856-d5fd-41c2-8da6-b867d9f0731a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.628759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.629801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.630298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.630784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.644134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.646093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:39:19.665893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:19.666813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:39:19.668109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:39:19.668109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:39:19.668109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:19.668283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.668546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.668826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.669114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.669829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.671030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 17/31] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:19.671282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.672286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.794945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c201f99-2f86-4bb7-a550-6bd87bf4b6d4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:19.812699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:19.829242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 15/32] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/roles => generated 219 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:19.830764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.833184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:19.834057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:19.834564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:19.835000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:19.836088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:19.836617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:19.838866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:19.849337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 18/33] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:19.850490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:19.883703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:19.966761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86f75e-8b56-439e-a098-a36a0975543f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.004538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2feb71-8557-474e-aa4f-7210e21a1164 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.011272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.012206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.012594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.012980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.013855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.015760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.035085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 16/34] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Aug 24 04:39:19 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:20.036372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.051283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.052266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.052694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.053136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.054141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:20.054600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.056432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd299ced-8e09-41de-9c3a-158399523490 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.080855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 19/35] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:20.082817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525d6b-6d08-4944-95ef-2640fbaa03c9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.083364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525d6b-6d08-4944-95ef-2640fbaa03c9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.083899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2525d6b-6d08-4944-95ef-2640fbaa03c9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.085935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 20/36] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:20.087760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2525d6b-6d08-4944-95ef-2640fbaa03c9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.144611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.173656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.185717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc673a0-a7f0-4d6e-952c-f7a65d8529cb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.229829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.230467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.230877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.231046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.232627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.234283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd8589a-a7f8-44ac-af76-8002265d08cd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.236173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 17/37] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:20 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:20.237493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.237771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.238053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.243802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2525d6b-6d08-4944-95ef-2640fbaa03c9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.275463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:20.277182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:20.300919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.301709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.301938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.302210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.302880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.304980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.376828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 18/38] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:20.378072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.524634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.533562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae446a6-e41f-4947-a37d-80936d7a84c1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.570829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 21/39] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/projects => generated 301 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:20.575721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.576786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.577286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.577816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.579490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.581303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24a396-be73-4b71-a991-77872e7061a0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.583369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 19/40] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:20.590560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.627181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ba2b6-6587-478b-a65f-a6d1e12d63e7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.628143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ba2b6-6587-478b-a65f-a6d1e12d63e7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.628760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ba2b6-6587-478b-a65f-a6d1e12d63e7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.632197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 20/41] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:20.645339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.646406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.647817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.672189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:20.673846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:20.776084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.784236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 21/42] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:20.785602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:20.791817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4948a-5b10-49b6-a8c8-af31c35d5a4b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:20.847115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:20.847775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:20.848061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:20.848350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] PATH_INFO: `/v3/domains/default/users/45426782369b4a9484d272e822de6396/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:20.850611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=45426782369b4a9484d272e822de6396, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:20.852272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:20.871176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 22/43] 10.222.0.85 () {58 vars in 1361 bytes} [Wed Aug 24 04:39:20 2022] PUT /identity/v3/domains/default/users/45426782369b4a9484d272e822de6396/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:20.956722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:20.970676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a110dfc-5c3b-4c6b-9d2c-a75f0c80d82d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:21.016276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:21.016940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.017222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.017498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.018177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:21.019629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:21.038311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 22/44] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Aug 24 04:39:20 2022] POST /identity/v3/roles => generated 223 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:21.081256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:21.246232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf85e9-d6c9-45d6-a649-50e6540786f8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:21.287487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:21.288151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.288435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.288711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.290512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:21.292057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ac351-bce4-43bb-a4f0-dba8a7c3f10d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:21.293708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 23/45] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:21.301813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:21.416908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e4c92-2f1d-4a00-ab8e-152b63af4070 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:21.459278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:21.459947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:21.460228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:21.460580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:21.461245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:21.463964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a9380-89ef-4136-8fcc-08fa815e19f7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:21.498743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 23/46] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:39:21 2022] POST /identity/v3/projects => generated 312 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:22.894552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bf6f-7280-4a51-81e3-ae443bcc7992 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.895075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bf6f-7280-4a51-81e3-ae443bcc7992 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.895178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bf6f-7280-4a51-81e3-ae443bcc7992 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.896500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 24/47] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:22.902528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389bbe-3049-47b0-a53e-af5e9a43dc58 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:22.902971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389bbe-3049-47b0-a53e-af5e9a43dc58 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:22.903085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10389bbe-3049-47b0-a53e-af5e9a43dc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:22.911252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:22.926749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-10389bbe-3049-47b0-a53e-af5e9a43dc58 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:22.928006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-10389bbe-3049-47b0-a53e-af5e9a43dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.033426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 24/48] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:23.307389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bf6f-7280-4a51-81e3-ae443bcc7992 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.329133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.430182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bf6f-7280-4a51-81e3-ae443bcc7992 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.456994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135068a-f043-4f6b-9f79-8f54c9160529 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.457279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135068a-f043-4f6b-9f79-8f54c9160529 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.457565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135068a-f043-4f6b-9f79-8f54c9160529 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.458915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 25/49] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:23.464941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.465227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.465509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.470689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.471334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.471657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.471935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.483703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:23.488694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:23.489912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:23.490763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:23.491351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:23.491351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:23.491493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 25/50] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:23.495778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.562381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 26/51] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:23.585308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.610534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baadf0-bf6f-4a86-84e9-c737acc55b90 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.655099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.655748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.656035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.656299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.656968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:23.657268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.658655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.668233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 26/52] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:23.673944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.745385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:23.790329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b9b1fe-746e-4b4d-a207-1779184de258 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.838919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.842829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.843499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.843775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.844049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.845179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.846643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.848262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 27/53] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:23.854504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:23.947614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa498d-6938-4cf2-8656-7df5a667e5e4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.974254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ead91d4-40fe-49e0-963a-49b3c0e8db3c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:23.985639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:23.986285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:23.986570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:23.986849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:23.988119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:23.989574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:23.991172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 27/54] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:23.997400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.005208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.010744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:24.011826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.012547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.012829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.013100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.014315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.015805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.017674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 28/55] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:24.023132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:24.110922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31785e-4a6a-4f37-86b6-4e7874bc01d7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.139881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49151d6-7ba5-4e90-9a53-264e4b377d9b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:24.151696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.152325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.152606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.152881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.153538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.155021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1289c-a8dd-4d36-beec-119ae733c6e7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.178465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:24.179118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:24.179401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:24.179717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:24.181018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.domain.id=default, user.id=45426782369b4a9484d272e822de6396) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:24.181331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:24.182804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d1e58-4065-4914-9c61-bb6134d4bafb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:24.185348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 28/56] 10.222.0.85 () {60 vars in 1140 bytes} [Wed Aug 24 04:39:23 2022] POST /identity/v3/projects => generated 298 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:24.193265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 29/57] 10.222.0.85 () {56 vars in 1322 bytes} [Wed Aug 24 04:39:24 2022] GET /identity/v3/role_assignments?user.id=45426782369b4a9484d272e822de6396&scope.domain.id=default&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 530 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:26.202517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f055-cfb9-4c21-b429-b2c6901c1d76 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:26.203070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f055-cfb9-4c21-b429-b2c6901c1d76 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:26.203070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67f055-cfb9-4c21-b429-b2c6901c1d76 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:26.204479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 29/58] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:26.209978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:26.210410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:26.210538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:26.229472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:26.230710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:26.293244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:26.302193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 30/59] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:26.577150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f055-cfb9-4c21-b429-b2c6901c1d76 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:26.651126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:26.697806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67f055-cfb9-4c21-b429-b2c6901c1d76 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:26.740970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:26.741575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:26.741855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:26.742128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:26.743385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:26.744862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338f103-c220-40f5-ae29-d0639a78f2e7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:26.746434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 30/60] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:26.752182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:26.853383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb96479-65b3-4396-9f1d-f147e812e3e0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:26.891190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:26.891818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:26.892099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:26.892366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:26.893005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:26.894431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488d958-1230-4d72-a6d7-bc9a8965ec31 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:26.921391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 31/61] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:26 2022] POST /identity/v3/users => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:30.049431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6439e-b4bf-4eaf-8d61-d3e1e726df34 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.052632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6439e-b4bf-4eaf-8d61-d3e1e726df34 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.052632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6439e-b4bf-4eaf-8d61-d3e1e726df34 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.054843 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 31/62] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:30.069670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359d58-9f8d-4e68-9249-2ae17034a82c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.071272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359d58-9f8d-4e68-9249-2ae17034a82c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.072282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28359d58-9f8d-4e68-9249-2ae17034a82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.109865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-28359d58-9f8d-4e68-9249-2ae17034a82c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:30.116131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-28359d58-9f8d-4e68-9249-2ae17034a82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:30.182904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.212015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 32/63] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:30.366071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55ae8-cb98-440e-8487-ebdc73dbd409 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.366071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55ae8-cb98-440e-8487-ebdc73dbd409 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.366071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f55ae8-cb98-440e-8487-ebdc73dbd409 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.366869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 32/64] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:30.374948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf918a-1155-4290-b363-2867c6229d92 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.375230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf918a-1155-4290-b363-2867c6229d92 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.375548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf918a-1155-4290-b363-2867c6229d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.404726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c8bf918a-1155-4290-b363-2867c6229d92 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:30.405952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c8bf918a-1155-4290-b363-2867c6229d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:30.544256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 33/65] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:30.562863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55ae8-cb98-440e-8487-ebdc73dbd409 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.588457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5a21-5762-4b75-ac08-b997235c5ca9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.589025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5a21-5762-4b75-ac08-b997235c5ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.589527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5a21-5762-4b75-ac08-b997235c5ca9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.591104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 34/66] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:30.596918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12837a-07e6-46c0-ae50-c908c9fd53d5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.597500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12837a-07e6-46c0-ae50-c908c9fd53d5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.598314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12837a-07e6-46c0-ae50-c908c9fd53d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.633183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fa12837a-07e6-46c0-ae50-c908c9fd53d5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:30.643121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fa12837a-07e6-46c0-ae50-c908c9fd53d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:30.745164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 35/67] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:30.749011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbafc-2552-4dff-b961-8dfa97d4ed7d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.750618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbafc-2552-4dff-b961-8dfa97d4ed7d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.751102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3cbafc-2552-4dff-b961-8dfa97d4ed7d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.753303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 36/68] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:30.759938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.760437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.760893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.765569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f55ae8-cb98-440e-8487-ebdc73dbd409 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:30.817208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.836797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:30.837507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:30.837849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:30.838432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:30.862854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:30.869045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:30.870061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:30.870951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 33/69] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:30.876047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.902284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:30.904263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:30.948523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:30.984862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 37/70] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:30.991493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:30.991710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f34d6-b273-4906-a6d5-aaf83955251f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.029869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.030772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.031193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.031638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.045788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-a70a4b2e-8b67-4fb6-9d90-34dfb28ecc21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:31.050734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:31.051999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:31.052752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 34/71] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:31.053534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e1b5-875b-4b48-a2c7-c054a0700df4 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.053714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e1b5-875b-4b48-a2c7-c054a0700df4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.054003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5194e1b5-875b-4b48-a2c7-c054a0700df4 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.055456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 35/72] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:31.058314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e1b5-875b-4b48-a2c7-c054a0700df4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.119412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.136707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb35d80f-cff5-4554-9278-c162d4e990bd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.174033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.174676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.175025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.175364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.176133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:31.176227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5194e1b5-875b-4b48-a2c7-c054a0700df4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.176501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.177936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3585fc-39ac-45db-91fa-57e275b9c805 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.195331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 38/73] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.195331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a624-ac14-4445-86f6-257706754b34 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.195331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a624-ac14-4445-86f6-257706754b34 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.195331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637a624-ac14-4445-86f6-257706754b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.210717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a637a624-ac14-4445-86f6-257706754b34 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:31.212805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a637a624-ac14-4445-86f6-257706754b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:31.218836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.219441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.219815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.220017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.220679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:31.220979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.222522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.236311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 36/74] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:31.236311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.247066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.298549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 39/75] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:31.299425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a624-ac14-4445-86f6-257706754b34 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.350965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a1026-7334-4319-ba91-116a609da745 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.363398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.389940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.390581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.390864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.391143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.403866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:31.409276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:31.410273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:31.411183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:31.413068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 37/76] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:31.413973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.424884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637a624-ac14-4445-86f6-257706754b34 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.464065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.464712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.464996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.465272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.490398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.492000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.499144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 40/77] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.499144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.525857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.535889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98421d-f340-4aeb-929a-11c7810ef783 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.573709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.574353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.574623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.574921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.576124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.577653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.579488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 38/78] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.583637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.624066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090255f-95e4-4155-8d35-b8ca03d4b94d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.624868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.663643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.664981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.664981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.664981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.677119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:31.682519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:31.687795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 41/79] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:31.688898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.700522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff95a7-a850-4c3d-b0c9-d6899377bb91 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.745265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.745927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.746235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.746518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.747197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:31.747532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.748950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.757566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 39/80] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.758618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:31.779361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.801636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c67f-6b04-464b-b775-3bcc3fc476d8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.848836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.849873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.850371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.850883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.875390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:31.879445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c01f1-bb60-47a2-b581-7abee4d81b1a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:31.921685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:31.922779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:31.923287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:31.923684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:31.924344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.925636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:31.925832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.928302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:31.931216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 40/81] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:31.932064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.022972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.041658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189c596-424e-4ccf-9ccc-efcf189466b4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.044689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 42/82] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:32.045361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.080491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.081135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.081369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.081639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.123483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.159563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e228cd-d1a5-43cb-bf94-691e3107944a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.173381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.174894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.202810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.203348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.203650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.203931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.204605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:32.204910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.206498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.215908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 43/83] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:32.216781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.272349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.290444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 41/84] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:32.291403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.346350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155f310-7266-41f6-9a23-3b0f7e3d6e02 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.381835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.389020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.389656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.389939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.390209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.391355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.392840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.394452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 44/85] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:32.395229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.420703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a7975-a755-4163-942f-bfbcaa7f1a1b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.465309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.465929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.466278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.466556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.467282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.468874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.497681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 42/86] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:32 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:32.498537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.547444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f1ab9-0657-4225-adff-e81f22f002d2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.564411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.599608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.600451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.600735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.601014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.602787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.604632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.607014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 45/87] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:32.607824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.647585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2dabc-a89c-45c6-8012-7a8cbf901f7b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.687625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.702781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.703892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.703892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.704510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.705549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.709271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.710684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 43/88] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:32.716013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.768377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5a45a-890e-44d4-863c-e62fbb83acfa None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.822388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.823143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.823958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.824243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.825478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:32.827146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:32.829133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 46/89] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:32.830994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:32.880835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d96abf-0f7c-42fd-92e6-c29c9b6594cf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:32.895354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:32.933792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:32.934419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:32.934697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:32.934968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:32.977366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e552ef-967f-4d1a-bc6d-910d43501cd9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.020276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.032823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.033840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.034263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.034672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.034777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.035684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:33.036159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.036264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.037882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.051769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 47/90] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=97c92764f4f344c5a16b60e86473677d => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:33.053055 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.172137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 44/91] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:33.173612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.293061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61032034-8c1b-4458-a9c7-c8c15898a397 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.295238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.308461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70046c8c-166a-4927-ac17-4116262d30cd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.311810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.343920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.344644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.344933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.345212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.354852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.355498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.355816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.356086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.356832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=45426782369b4a9484d272e822de6396) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:33.357141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.358620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.365314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 45/92] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:33 2022] GET /identity/v3/role_assignments?user.id=45426782369b4a9484d272e822de6396&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:33.365936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.497483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4fb80-c43b-48d8-82e6-e84c2bdba867 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.525099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.526662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.543435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.544063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.544379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.544663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] PATH_INFO: `/v3/projects/55a71e297ceb49f080aaff37097bf3f1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.545905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] RBAC: Authorizing `identity:get_project(project_id=55a71e297ceb49f080aaff37097bf3f1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.547370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.549123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 46/93] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:33 2022] GET /identity/v3/projects/55a71e297ceb49f080aaff37097bf3f1 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:33.557537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.608837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:33.714120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0c7e-ce24-472a-9085-693af969057b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:33.769148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:33.770312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:33.771822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:33.772481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:33.775435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=55a71e297ceb49f080aaff37097bf3f1, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:33.777843 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:33.780818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:33.798221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 47/94] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:33 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=55a71e297ceb49f080aaff37097bf3f1&role.id=97c92764f4f344c5a16b60e86473677d => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:33.844897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 48/95] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:33.850837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:33.993411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:34.017914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823734-f2aa-4b00-83ce-f544282b8f01 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:34.075406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:34.076505 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:34.077000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:34.077493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:34.079077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:34.080847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb97531-2810-4a99-b0f0-de805f592afe None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:34.083169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 48/96] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:33 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:34.089957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:34.123906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:34.235190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161f168-2549-4648-b1fd-6b454c43eaa1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:34.279005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:34.279678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:34.279999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:34.280230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:34.280973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:34.281276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:34.282720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0da0-6d20-4e2d-80e2-d986ba222a15 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:34.289591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 49/97] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:34 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:35.402750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da26f-12bc-4435-867e-5d9282497b86 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.403256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da26f-12bc-4435-867e-5d9282497b86 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.403427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da26f-12bc-4435-867e-5d9282497b86 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.404810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 49/98] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:35.421496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c97c-8e19-487e-adb3-bbfd3fb17950 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.421993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c97c-8e19-487e-adb3-bbfd3fb17950 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.422063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5c97c-8e19-487e-adb3-bbfd3fb17950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.448344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-42a5c97c-8e19-487e-adb3-bbfd3fb17950 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:35.449571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-42a5c97c-8e19-487e-adb3-bbfd3fb17950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:35.535229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 50/99] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:35.610538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70603-f082-4059-bdc4-5f3a765460c1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.611164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70603-f082-4059-bdc4-5f3a765460c1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.611687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f70603-f082-4059-bdc4-5f3a765460c1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.613240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 50/100] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:35.619327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892c73-6aeb-468e-9683-1d9da4ed637f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:35.619885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892c73-6aeb-468e-9683-1d9da4ed637f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:35.620409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd892c73-6aeb-468e-9683-1d9da4ed637f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:35.631810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:35.649050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bd892c73-6aeb-468e-9683-1d9da4ed637f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:35.650615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bd892c73-6aeb-468e-9683-1d9da4ed637f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:35.740867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 51/101] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:35.871161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70603-f082-4059-bdc4-5f3a765460c1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.004691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f70603-f082-4059-bdc4-5f3a765460c1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.041156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde06a-e6ed-4845-b2ec-06f1fbe06b7e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.041768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde06a-e6ed-4845-b2ec-06f1fbe06b7e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.042235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde06a-e6ed-4845-b2ec-06f1fbe06b7e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.043981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 52/102] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:36.049373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.049761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.050037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.050127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.050754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.051046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.051326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.071147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:36.080447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:36.081302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:36.082054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 51/103] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:36.088770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.090533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:36.091771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:36.125988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.255100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 53/104] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:36.260493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.298018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404fc9d-a31c-4c9d-ae3f-d113aff2b5ae None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.376841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.377826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.379747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.380248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.381127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:36.383240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.386531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.398557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.408317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 52/105] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:36.414914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.465060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876bb62-2f51-49fe-87b0-383cbef14bc2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.510124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.510716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.510997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.511285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.512892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.514416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d457f9-c084-42e3-85eb-13d1985bc39e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.516012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 54/106] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:36.517581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1902a-89d6-44b9-863a-947ddd9d746e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.517872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1902a-89d6-44b9-863a-947ddd9d746e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.518146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1902a-89d6-44b9-863a-947ddd9d746e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.524552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 55/107] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:36.525628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1902a-89d6-44b9-863a-947ddd9d746e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.582401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.608742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca040de-c840-49fb-b9bf-91531bcc9109 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.671830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.672480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.672762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.673038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] PATH_INFO: `/v3/users/da155f6606ef4bd1a751356011e7d961` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.680994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1902a-89d6-44b9-863a-947ddd9d746e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:36.688094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] RBAC: Authorizing `identity:get_user(user_id=da155f6606ef4bd1a751356011e7d961)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.689624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d88bb4-6c03-4cb8-99b9-751696df7af3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.691614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 53/108] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/users/da155f6606ef4bd1a751356011e7d961 => generated 289 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:36.693245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.693536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.693814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.714820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:36.716468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:36.717345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.723802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:36.724412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.724693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.724964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.725621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:36.728484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372e53-3727-4efc-aa04-df8efb972dc5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:36.758755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 56/109] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:39:36 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:36.760349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ddb0f-c4dd-4dbb-89ff-936947538a42 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:36.760674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ddb0f-c4dd-4dbb-89ff-936947538a42 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:36.760962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ddb0f-c4dd-4dbb-89ff-936947538a42 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:36.762654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 57/110] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:36.763459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ddb0f-c4dd-4dbb-89ff-936947538a42 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.807148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 54/111] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:36.814519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:36.952320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:36.969975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ddb0f-c4dd-4dbb-89ff-936947538a42 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.005924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69891e08-0ec4-429f-b55d-cbc0b4e9dca6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.013113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.013735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.014017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.014296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.057320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.058288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.059572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.059860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.075760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-f4567465-aeba-4743-a10e-6b224d53f870 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:37.080752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:37.081624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:37.082397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 55/112] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:37.087182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.089154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.089154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.089323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.110021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.111846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:37.112621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.112776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:37.200531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 56/113] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:37.201423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.245690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 58/114] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:37.246904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.296635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.348764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.368215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0bab9-3209-4fca-8865-0342a6ba17de None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.391518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6fd80-7306-416b-819c-59725acfbefb None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.421615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.422251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.423497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.423497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.423497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:37.424442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.427995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.429345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.430607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.430943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.431221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.453807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 57/115] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.454703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.464203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:37.469271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:37.470529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 59/116] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:37.472795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.579950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c28220-0186-4321-8d94-a9ad399ef7cd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.598405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.616507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.617677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.617960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.618238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.619394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.620872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.622519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 58/117] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.623288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.629487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9d47-3882-4c46-a392-3b8a2fcc78a3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.669315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.669953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.670585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.670887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.672391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.674011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.680520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 60/118] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.680520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.694140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.739677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6943e-7c0b-4d66-b4e8-6df359ecc213 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.776450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.777063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.777344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.777620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.778280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:37.778587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.779995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169688a5-3a9a-44eb-ac8e-8395d840d3a0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.786059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e5e54-cb10-4a9a-ad4f-c979131044b2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.788387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 59/119] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.789710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bfd2-a6eb-4910-bdb4-8f3e41bdc490 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.789999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bfd2-a6eb-4910-bdb4-8f3e41bdc490 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.790276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060bfd2-a6eb-4910-bdb4-8f3e41bdc490 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.791706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 60/120] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:37.792298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060bfd2-a6eb-4910-bdb4-8f3e41bdc490 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.830934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.831649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.831930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.832202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.845733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:37.850466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:37.851878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:37.852791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 61/121] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:37.853409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:37.856116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.919313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060bfd2-a6eb-4910-bdb4-8f3e41bdc490 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.934772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:37.959209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:37.959859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:37.960145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:37.960454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:37.961423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=da155f6606ef4bd1a751356011e7d961) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:37.961740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:37.963181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:37.967610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941d665-8ac8-4039-b419-40617e5f06da None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:37.968971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 61/122] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/role_assignments?user.id=da155f6606ef4bd1a751356011e7d961&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:37.969782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.024577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.025828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.026391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.026669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.028080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.029592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d645a-3b12-4500-8de2-8b5bee9a1494 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.031563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 62/123] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:38.032602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.033014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.033298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.056547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:38.057795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:38.118085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39146ba-ef62-4dfd-bb95-acd30166c6cf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.138268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.160166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 63/124] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:38.161251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.176663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.177612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.178772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.179338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.182462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.186061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.190278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 62/125] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:37 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:38.191209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.291454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.325030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba160ad-0d7b-4136-a589-3b946ae91ef2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.362908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.363534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.363819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.364093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.364771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:38.365072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.366450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.376112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 64/126] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:38.376880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.378567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985ea48-11a3-4dc5-98a6-40d240c38d6d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.445562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.446332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.446527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.446808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/0eb94d3a0da1487c9b4748256681e307/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.453181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, user_id=0eb94d3a0da1487c9b4748256681e307, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.453181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.485323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e16225-cd89-4a14-b40a-b29dfb105c62 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.492440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 63/127] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:38 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/0eb94d3a0da1487c9b4748256681e307/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:38.492440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.520940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.527308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.528029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.528311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.528617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.530032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.531530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.533415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 65/128] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:38.542342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.596063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.687740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69558574-a652-4cfc-87cf-da6a5a07ffd2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.732572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.733240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.733522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.733798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/45426782369b4a9484d272e822de6396/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.735664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38744b9b-a0b2-4a06-b8ba-d7a9c053d00a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.735792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, user_id=45426782369b4a9484d272e822de6396, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.737237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.757359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 66/129] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:38 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/45426782369b4a9484d272e822de6396/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:38.758843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.786770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.787426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.787836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.788125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:38.792404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:38.793945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:38.795848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 64/130] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:38.802140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:38.835321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:38.936186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386fdf7-4c87-475e-a39d-6e4e66479744 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:38.993309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:38.993909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:38.994271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:38.994547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.005964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:39.012711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:39.014685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:39.015779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 67/131] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:39.024205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.028585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25701-d482-4d48-b0e8-b7730c0f981c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.040462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.088953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.089883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.090313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.090763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] PATH_INFO: `/v3/projects/55a71e297ceb49f080aaff37097bf3f1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.092144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] RBAC: Authorizing `identity:get_project(project_id=55a71e297ceb49f080aaff37097bf3f1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.093734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.099601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 65/132] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:38 2022] GET /identity/v3/projects/55a71e297ceb49f080aaff37097bf3f1 => generated 312 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:39.102019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.148454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524dd8f-6744-4961-9cf7-0f2b6f8fe5ed None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.187147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.187805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.188087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.188364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.189488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:39.189488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.190836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6a345-7201-4584-a791-ad5df8379de5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.201111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 68/133] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:39.205715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18af-dff3-4a7b-94bb-24d03ce30e29 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.205715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18af-dff3-4a7b-94bb-24d03ce30e29 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.205715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e18af-dff3-4a7b-94bb-24d03ce30e29 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.205715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.206109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 69/134] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:39.212261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.212637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.212988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.225628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d311f61-4054-4871-9477-b96348d204ab None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.236202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:39.237901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:39.268662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.269368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.269713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.269995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] PATH_INFO: `/v3/projects/55a71e297ceb49f080aaff37097bf3f1/users/0eb94d3a0da1487c9b4748256681e307/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.271986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=55a71e297ceb49f080aaff37097bf3f1, user_id=0eb94d3a0da1487c9b4748256681e307, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.274025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.299502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 66/135] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:39 2022] PUT /identity/v3/projects/55a71e297ceb49f080aaff37097bf3f1/users/0eb94d3a0da1487c9b4748256681e307/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:39.299502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.354454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 70/136] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:39.382188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.486569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a327f3-ea6f-4a8a-a108-9dc10bea81a7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.537080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.537646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.537928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.538199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.540208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.541716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.543703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 67/137] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:39 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:39.549548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.677407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733c04a4-0cad-474b-a4de-676adc6fd72b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.692699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.721002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.721648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.721941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.722221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.723386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.724855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.727422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 71/138] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:39 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:39.733280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.791297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:39.878257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d824d-8534-4f72-9736-5e4f86936e4c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:39.883094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:39.950473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:39.951158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:39.951446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:39.951756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/0eb94d3a0da1487c9b4748256681e307/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:39.959708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, user_id=0eb94d3a0da1487c9b4748256681e307, role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:39.961449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:39.992869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 68/139] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:39 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/0eb94d3a0da1487c9b4748256681e307/roles/65fa064da25d44d5b45bbdf45796d403 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:40.010597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9378281-981a-4248-8502-4ca6ef7da82c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:40.048536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:40.049104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.049385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.049661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.050834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:40.052409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48073aee-b341-469c-94a2-aff53631ebda None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:40.054850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 72/140] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:40.061007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:40.194421 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9922ebc-63fb-4db1-939b-9231c7a08e58 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:40.230195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:40.230814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.231096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.231378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.232072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:40.233517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da0e0d-1345-4611-945c-b57e656f7275 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:40.261510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 69/141] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:40 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:40.845821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d57-1fee-4e1e-8181-9678aad60e18 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.846366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d57-1fee-4e1e-8181-9678aad60e18 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.846366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85296d57-1fee-4e1e-8181-9678aad60e18 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.848222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 73/142] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:40.859183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c05bc4-e9a8-42e2-9411-18c6ba88bb0d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:40.860117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c05bc4-e9a8-42e2-9411-18c6ba88bb0d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:40.860587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c05bc4-e9a8-42e2-9411-18c6ba88bb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:40.888506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-56c05bc4-e9a8-42e2-9411-18c6ba88bb0d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:40.890043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-56c05bc4-e9a8-42e2-9411-18c6ba88bb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:40.906237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:40.981886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 70/143] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:41.534497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296d57-1fee-4e1e-8181-9678aad60e18 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.600218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:41.621057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f098-31f7-4002-b9a4-da0772216798 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.621685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f098-31f7-4002-b9a4-da0772216798 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.622177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97f098-31f7-4002-b9a4-da0772216798 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.624059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 71/144] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:41.638788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63a552-0094-4bbb-9a31-a5edc72681d7 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.639457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63a552-0094-4bbb-9a31-a5edc72681d7 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.639977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63a552-0094-4bbb-9a31-a5edc72681d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.667541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85296d57-1fee-4e1e-8181-9678aad60e18 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:41.676213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8e63a552-0094-4bbb-9a31-a5edc72681d7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:41.677860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8e63a552-0094-4bbb-9a31-a5edc72681d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:41.722201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:41.722894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.723176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.723448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:41.747576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:41.748427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:41.749247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 74/145] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:41.754554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:41.782262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 72/146] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:41.810848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041066a-b00d-4608-8bf8-a947a620a7fd None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.811529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041066a-b00d-4608-8bf8-a947a620a7fd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.812021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b041066a-b00d-4608-8bf8-a947a620a7fd None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.813974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 73/147] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:41.820583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.820941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.821290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.857080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:41.858568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:41.902899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac61348-e227-4cbb-9483-5989774592d8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:41.921177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:41.962354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 74/148] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:41.964824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:41.965747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:41.966226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:41.966733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:41.967659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:41.968152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:41.969750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:41.983026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 75/149] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:41.988773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.007806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.111219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8561b9b5-5f65-4656-9a2c-72359a6030f8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.159866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.160528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.160809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.161084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] PATH_INFO: `/v3/users/da155f6606ef4bd1a751356011e7d961` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.162262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] RBAC: Authorizing `identity:get_user(user_id=da155f6606ef4bd1a751356011e7d961)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.164075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.165696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 75/150] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:41 2022] GET /identity/v3/users/da155f6606ef4bd1a751356011e7d961 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:42.171492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.189671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.314693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.330364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547e1def-3aac-4353-9958-64a957dde698 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.340009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fe36d-bf90-477f-b8d6-9fe83c6e90e1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.400232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.400900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.401172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.401446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.408196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.408863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.409139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.409410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.410611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.412105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.414263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 76/151] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:42.417620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:42.419713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8b5e74d6-fa0a-41fd-83b2-7593065db82a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:42.422994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:42.423857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:42.424611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 76/152] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:42.457399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8d33-894f-4feb-ba28-81d82cba4f0a None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.458069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8d33-894f-4feb-ba28-81d82cba4f0a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.458320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f8d33-894f-4feb-ba28-81d82cba4f0a None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.462126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 77/153] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:42.462969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8d33-894f-4feb-ba28-81d82cba4f0a None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.497027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.606102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7292ae-1b7c-47b6-a2e6-c1968319a00f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.663209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.664942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.665418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.665886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/da155f6606ef4bd1a751356011e7d961/roles/b370b1ccd3b34d3a99ebfa0f634f9608` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.670958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, user_id=da155f6606ef4bd1a751356011e7d961, role_id=b370b1ccd3b34d3a99ebfa0f634f9608)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.672767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3a10-fa6a-41e0-9f8a-db486f1a0cff None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.688207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f8d33-894f-4feb-ba28-81d82cba4f0a None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:42.701107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 77/154] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:42 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/users/da155f6606ef4bd1a751356011e7d961/roles/b370b1ccd3b34d3a99ebfa0f634f9608 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:39:42.702960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.703498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.704022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.725067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:42.727257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:42.754456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:42.755090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:42.755368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:42.755668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:42.756346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:42.756648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:42.758355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:42.766860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.775880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 78/155] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:42.776934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.821328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 78/156] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:42.822578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:42.878944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:42.955503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e7688-110d-4904-ad56-efc039885fc4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.001598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656afaa-66b7-40a8-abed-40d37b7ed448 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.024263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.024927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.025132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.025407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.036774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:43.044762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:43.045815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:43.046660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 79/157] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:43.051756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.064732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.065898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.066621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.067539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] PATH_INFO: `/v3/users/45426782369b4a9484d272e822de6396` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.072157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] RBAC: Authorizing `identity:get_user(user_id=45426782369b4a9484d272e822de6396)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.074290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.076569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 79/158] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:42 2022] GET /identity/v3/users/45426782369b4a9484d272e822de6396 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.082267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.129896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.181489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b8321-f62c-4997-8219-6d69f84f8309 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.227499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.228130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.228408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.228681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.229358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:43.229658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.231428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.242334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 80/159] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:43.249361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.292814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.320052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df29b58-9220-4ec6-a4d3-0174466540d0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.395586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.396354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.396641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.396919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.430723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2f769-5d7c-401f-9e52-d8ab63363170 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.469717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.490141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.490797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.491078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.491403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.494426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.496029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.499635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 81/160] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:43.504998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.541022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.542519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:43.752765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4563bd-2571-47a6-abe3-3e2f7f75628c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:43.752956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.765702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 80/161] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:39:43.766891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:43.817610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:43.818239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:43.818515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:43.818783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:43.919500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:43.936637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:43.938269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a4112-e6b5-41b4-beb2-c13216d20636 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.048143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899326ad-562f-48bc-a3aa-812e51aae084 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.114774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.115505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.115801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.116078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.126856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 82/162] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:39:44.128377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:44.129020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee15a1-e867-44c4-929d-6a7f0f06ae8e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.129508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee15a1-e867-44c4-929d-6a7f0f06ae8e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.129980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee15a1-e867-44c4-929d-6a7f0f06ae8e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.131776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 83/163] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:44.139888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:44.140787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 81/164] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:44.141548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.143671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee15a1-e867-44c4-929d-6a7f0f06ae8e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.260339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.334140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.344128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc6989-9780-4509-8d3d-d7b5f60a1976 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.359595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee15a1-e867-44c4-929d-6a7f0f06ae8e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.412620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.413941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.414260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.414542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.418014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.420717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.421360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.421637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.421908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.422822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd233d-d6a5-4d76-ab75-48f239ae6157 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.424532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 82/165] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:44.425675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.425961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.426235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.429129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.430755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.432608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 84/166] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:44.433243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.465445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:44.466675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:44.601020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 83/167] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:44.602148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.659298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f32a05-9900-42ed-b291-e3a6d51bed6b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.697534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.736750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.737737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.738231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.738700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.739587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:44.740104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.742391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.756557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 85/168] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:44.758290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.783496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2c07a-43a0-468d-bb68-c8737fc3b15c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:44.805621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:44.861883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:44.862633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.862917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.863376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.864299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=45426782369b4a9484d272e822de6396) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:44.867794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:44.869779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2600bb-cb90-4114-824a-fceb810e4348 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:44.890731 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 84/169] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/role_assignments?user.id=45426782369b4a9484d272e822de6396&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:44.891955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9931c-bc49-4a26-b5ea-4b687be9c40f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:44.892242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9931c-bc49-4a26-b5ea-4b687be9c40f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:44.892514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9931c-bc49-4a26-b5ea-4b687be9c40f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:44.897391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 85/170] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:44.897391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9931c-bc49-4a26-b5ea-4b687be9c40f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:44.981884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6498b-5f34-452d-8f9f-32207eb8dd29 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:45.073326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:45.074344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.074837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.075300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.076266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:45.076799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:45.078477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cc3526-587a-43a5-8455-31e04b78e91c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:45.090032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 86/171] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=97c92764f4f344c5a16b60e86473677d => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:45.091316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.091612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.091889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.128576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:45.129738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:45.157933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9931c-bc49-4a26-b5ea-4b687be9c40f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:45.203848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:45.261463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:45.262128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.262407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.262684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.263927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:45.265406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:45.271713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 86/172] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:44 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:45.272918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:45.339168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 87/173] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:45.340215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:45.375547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:45.489160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36892a8a-5991-43bf-bc08-b8478db70484 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:45.492765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d7bf8-b58a-45c6-9c4d-a550d0280609 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:45.540751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:45.541737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.542132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.542519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.543374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:45.544189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.544606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.545038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.561060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d8fedb2f-7532-40f8-a613-809245c6ef6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:45.568580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:45.569566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:45.570427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:45.572836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 87/174] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:45.576722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456831c0-2979-42a5-8d96-1141478316ef None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.577157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456831c0-2979-42a5-8d96-1141478316ef None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.577574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456831c0-2979-42a5-8d96-1141478316ef None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.579564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 88/175] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:45.581306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282ed-1f4d-4bf9-9351-0f804d54d434 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.582076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282ed-1f4d-4bf9-9351-0f804d54d434 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.582492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282ed-1f4d-4bf9-9351-0f804d54d434 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.584507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 89/176] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:45.586302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e282ed-1f4d-4bf9-9351-0f804d54d434 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:45.656083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:45.660677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:45.662186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c1b8-687c-45aa-b9c3-56e2113e4595 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:45.686522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:45.740177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e282ed-1f4d-4bf9-9351-0f804d54d434 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:45.785232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:45.786485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.787324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.788621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.789747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:45.790693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:45.792853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61f823-357a-48d3-9c6e-ee0d5063f593 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:45.797543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 88/177] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:45.802954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 90/178] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:45.803754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.804562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.804842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.805889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:45.806439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:45.806907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:45.825759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:45.826952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:45.829286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:45.831256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:45.905409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 89/179] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:45.906330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:45.909821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 91/180] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:45.910659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:45.978000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:45.981877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.045939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d48bf-5eac-4376-b2d8-16f50a5f9f4c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.067362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d454b-efee-43b0-8c40-590c4080e8dc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.083808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.084797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.085910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.086379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] PATH_INFO: `/v3/projects/55a71e297ceb49f080aaff37097bf3f1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.087767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] RBAC: Authorizing `identity:get_project(project_id=55a71e297ceb49f080aaff37097bf3f1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.089509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.091496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 90/181] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:45 2022] GET /identity/v3/projects/55a71e297ceb49f080aaff37097bf3f1 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.092601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.121609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.122261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.122542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.122817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.137578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ce687f18-c451-4303-9e38-fd3a2a721b47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:46.143875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:46.144755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:46.145888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 92/182] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:46.146754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa8f0-3f26-4464-a9f3-db522202d66b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.146991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa8f0-3f26-4464-a9f3-db522202d66b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.147341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3aa8f0-3f26-4464-a9f3-db522202d66b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.149885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 93/183] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:46.151222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa8f0-3f26-4464-a9f3-db522202d66b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.219060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bbdb0-6cfe-41d8-86ae-9de98dc03e4e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.233198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.260707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.261550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.261823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.262908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] PATH_INFO: `/v3/users/0eb94d3a0da1487c9b4748256681e307` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.263232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] RBAC: Authorizing `identity:get_user(user_id=0eb94d3a0da1487c9b4748256681e307)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.264696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.266300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 91/184] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/users/0eb94d3a0da1487c9b4748256681e307 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.272258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.276169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.283339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3aa8f0-3f26-4464-a9f3-db522202d66b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.319086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.319907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.320186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.320451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.321523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=55a71e297ceb49f080aaff37097bf3f1, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:46.321523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.322968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d97f9c-0f9e-4916-931d-9cf024036255 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.330641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 94/185] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=55a71e297ceb49f080aaff37097bf3f1&role.id=97c92764f4f344c5a16b60e86473677d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.332045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.332248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.332512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.360603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:46.361855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:46.387613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78d922-6880-40d6-a65a-793b2c5ca891 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.427969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.428593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.429441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.429714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.430397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:46.430700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.432128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.440410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 95/186] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:46.446538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 92/187] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.446538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.448514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.503901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.579785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.582757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b0033b-f003-40f1-b530-7e81c3cca9b2 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.592481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671147fc-05e2-4daa-b7c9-3681424c1cf2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.626166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.626800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.627074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.627399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.628535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.629911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.631374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.632544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 93/188] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.632897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.633185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.633328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.633566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.644594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:46.649429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:46.650310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 96/189] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:46.655920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.746563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fc9-32b0-46d6-bd1a-200a6401a043 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.757618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18e1d4-dc7d-4875-8b3f-8d42595497f7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.757802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.782129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.782736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.783013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.783283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.791430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.792078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.792350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.792620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.806662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.808359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.810032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 97/190] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:46.810862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.825013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:46.860001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.861399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.916302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1c2f-49a7-47fa-8e27-3c9f6b9c5f0f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:46.950962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:46.951266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:46.951565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:46.951900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:46.952593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:46.954094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:46.971454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 94/191] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:46.972388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.995511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 98/192] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:46 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:46.995511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:46.995847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.064341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.094225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79eb05-97eb-46d6-bd35-ee95a223acbc None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.114739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b1199-32e4-47c0-a1b2-a4b5d0893bad None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.142057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.142714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.142994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.143273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.143985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.144295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.145686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.156413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 95/193] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.157373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.160254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.161774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.162065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.162339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.176767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:47.182698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:47.183785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:47.184645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:47.185572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 99/194] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:47.185880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.255407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.300873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5a363-02f8-40a2-989c-db1c08214084 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.341919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb121a92-fa58-4252-8b6e-627af35339ad None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.349760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.350927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.351188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.351462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.383055 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.391882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.392528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.392813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.393092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.394257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.395753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.398509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 100/195] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.404352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.429181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.430989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.513709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.521029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4957833-a81b-41a5-b37a-3c7360a9e3ba None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.546954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 96/196] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:47.548061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.567138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.568008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.568499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.568869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.570875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.572507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.574826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 101/197] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.580882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.651183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.660671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4e42e-5b6d-417d-aebe-feb7babcaa84 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.695407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f3e3f9-b18d-4dab-883f-2973c521c029 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.698303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.699023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.699375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.699760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.700511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.700884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.702401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.711932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 97/198] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.712692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.733886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.734501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.734833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.735115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.735883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=0eb94d3a0da1487c9b4748256681e307) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:47.736190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.737631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.744773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 102/199] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/role_assignments?user.id=0eb94d3a0da1487c9b4748256681e307&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.745481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.774996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.826246 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d8e9eb-89c3-4f79-845d-8f3a66564e41 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.864256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68f9a-76e6-421f-943d-917454cd90ab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.867490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.868189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.868469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.868745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.869920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:47.871378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:47.873121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 98/200] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:47.873925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:47.914847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:47.935076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:47.935735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:47.936015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:47.936284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:47.984663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85c16b-0643-4b89-8171-05d75b31d041 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:47.987850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.024552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.025458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.025882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.026294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] PATH_INFO: `/v3/users/da155f6606ef4bd1a751356011e7d961` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.027797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] RBAC: Authorizing `identity:get_user(user_id=da155f6606ef4bd1a751356011e7d961)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.029407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.031175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 99/201] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/users/da155f6606ef4bd1a751356011e7d961 => generated 289 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.040523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.051761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.053302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.171113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 103/202] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:48.172018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.193324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739344f6-54f8-489e-9286-a78d321b1312 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.208497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.260773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.261438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.261714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.261989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.262720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=80e305254b6d46649e778345fb1caca1) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:48.263132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.264909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.270324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 100/203] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/role_assignments?user.id=80e305254b6d46649e778345fb1caca1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.271191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.312872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f9a14-18f3-4b9c-a440-f33bf64b9f5f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.326140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.370051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.370734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.370944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.371217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.424837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a170d-3fb4-4e80-9521-9b31061dad5d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.476700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.477783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.478063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.478336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.479954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.481417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.483267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 101/204] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.489654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.509697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.511282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.554227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.663892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 104/205] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:48.669034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:48.701829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4006bf-471b-4204-89cf-ce52f1b38b6e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.706528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.777616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cc4896-5326-49d5-a037-f4337b9ee339 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:48.785562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.786448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.786927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.787392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.789152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=80e305254b6d46649e778345fb1caca1) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:48.789724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.791381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.807813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 102/206] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/role_assignments?user.id=80e305254b6d46649e778345fb1caca1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 259 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:48.811498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:48.828374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:48.829036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:48.829310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:48.829581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:48.832432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:48.833883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba47c0a-8429-414a-b316-0e4431195b61 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:48.836740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 105/207] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:48.842768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:49.001550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42390e7-625c-488b-95a4-0691b3884e94 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:49.043778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:49.044401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.044679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.044949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.045684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, scope.project.id=b84e078154c949168ec4bafbe86e7a15, user.id=da155f6606ef4bd1a751356011e7d961) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:49.045990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:49.047709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199df397-864f-4307-ae16-0f8f13d8680a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:49.054937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 103/208] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:48 2022] GET /identity/v3/role_assignments?user.id=da155f6606ef4bd1a751356011e7d961&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:49.348495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5698efd-c4b0-4efd-ab72-3fd5be39aace None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.348866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5698efd-c4b0-4efd-ab72-3fd5be39aace None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.349052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5698efd-c4b0-4efd-ab72-3fd5be39aace None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.350411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 106/209] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:49.356176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f184e5-af76-498e-a100-0552147acc6d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.356632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f184e5-af76-498e-a100-0552147acc6d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.356717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f184e5-af76-498e-a100-0552147acc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.375672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-27f184e5-af76-498e-a100-0552147acc6d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:49.377006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-27f184e5-af76-498e-a100-0552147acc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:49.404835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:49.459397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 104/210] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:49.472389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401fcf-8299-42ae-8296-8091f7c0129c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.472883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401fcf-8299-42ae-8296-8091f7c0129c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.472970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8401fcf-8299-42ae-8296-8091f7c0129c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.474249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 107/211] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:49.480377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.480663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.480940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.504042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:49.505524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:49.586339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 105/212] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:49.758019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8401fcf-8299-42ae-8296-8091f7c0129c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:49.867177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8401fcf-8299-42ae-8296-8091f7c0129c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:49.884137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:49.906734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:49.907810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:49.908322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:49.908780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:49.921478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:49.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:49.927898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:49.928831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:49.931807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 108/213] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:49.940597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.003938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.025140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7442e3-6949-469e-9139-23e1661d9178 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.027831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.067629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.068363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.068646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.068915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.070688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.071612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c786cbb1-c010-48d3-999b-9853f96ad015 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.072240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.074097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 106/214] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:50.079930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.113293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.114183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.114456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.114723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.115577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:50.116256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.118351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.133939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 109/215] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:50.143506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.214052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a16e0-c007-41e5-be26-16fd2d2ae98e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.253954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.254564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.254840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.255107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.255945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.257813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.282795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d106413-4e0d-4cbe-a387-8b8d87ab96e3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.283886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 107/216] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:50 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:39:50.308668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.332973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.334239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.334811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.335346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] PATH_INFO: `/v3/users/b8b9ca088efe457b9f1ed94bd75335a1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.354892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b9ca088efe457b9f1ed94bd75335a1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.356932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450692c1-3260-4c74-9b71-7d1d4bcec3b7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.359256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 110/217] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:50 2022] GET /identity/v3/users/b8b9ca088efe457b9f1ed94bd75335a1 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:50.365703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.386735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.497422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e53b36a-2fab-4b61-8451-ae29028850cb None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.533896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.534429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.534704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.534973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.578698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168613d1-326b-4a62-9aee-18161130f552 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.579220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168613d1-326b-4a62-9aee-18161130f552 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.579220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168613d1-326b-4a62-9aee-18161130f552 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.580782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 111/218] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:50.587039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.587328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.587634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.608079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:50.609289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:50.616486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.618106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.636994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.695506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 112/219] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:50.757938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 108/220] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:50.763757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:50.878148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485c6f87-4e40-44ca-aae1-9bd9f66c204f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:50.881008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:50.918782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:50.919792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:50.920333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:50.920801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:50.922178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:50.923843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:50.925689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 113/221] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:50 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:50.932434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.016315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.063933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfccd4-3566-44ca-b555-52f5f3106f75 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.088423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.115652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.116983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.117258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.117525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.118261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=b8b9ca088efe457b9f1ed94bd75335a1) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:51.118569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.120057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931211f-c993-44bb-ab03-0ec161580b08 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.126179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 109/222] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:50 2022] GET /identity/v3/role_assignments?user.id=b8b9ca088efe457b9f1ed94bd75335a1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=97c92764f4f344c5a16b60e86473677d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:51.127696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9f1d-0370-4e98-b9b4-3391024a6731 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.127981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9f1d-0370-4e98-b9b4-3391024a6731 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.128308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef9f1d-0370-4e98-b9b4-3391024a6731 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.135007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 110/223] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:51.136482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.136770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.137044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.152801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22f0e6-d64f-46e0-bcf8-c0100573cea8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.158163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:51.159407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:51.198112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.198749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.199029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.199390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.211710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:51.216584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:51.217442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:51.218230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 114/224] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:51.225255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.250986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 111/225] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:51.283509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.380692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da32a05-a3ea-42aa-abf4-5cb0fe1e96a6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.417252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.417933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.418215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.418486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.419156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:51.419455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.420858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.432869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 115/226] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:51.438591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.559178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cba3eb-9b26-493d-b368-733bfeda32c0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.569748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.597194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.597839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.598121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.598390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.599546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.601096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.603049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 112/227] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:51.610877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.678102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.783029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:51.792180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370439-ba5d-4fed-b456-c36eedb18bce None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.801465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbbc917-42d5-4d49-ac8a-0453c970cffa None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:51.833240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.833880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.834157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.834428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.857952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:51.863453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:51.864430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:51.865648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 113/228] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:51.872610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.884041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:51.884692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:51.884971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:51.885243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:51.888201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:51.889649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:51.891562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 116/229] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:51.900935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:51.936551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.069530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f9eda-5ffb-4eba-83bb-9054f3c4a694 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.105446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc3791-91e7-45b4-8344-b9f00e9de169 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.111726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.112653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.113162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.113635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.115000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:52.115541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.117733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.127759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 114/230] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:52.134099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.241449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.242461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.242763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.243039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/80e305254b6d46649e778345fb1caca1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.243500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.248610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583538b1-d779-4fdd-8b59-57b295dc4855 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.252173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, user_id=80e305254b6d46649e778345fb1caca1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.253650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.277700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 117/231] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:51 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/80e305254b6d46649e778345fb1caca1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:52.300740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.301753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.302202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.302669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.304874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.306573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.316081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 115/232] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:52.324644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.386471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.513786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccd67a-0fb7-4875-b0ec-99bc88e959bf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.567196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.567885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.568167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.568438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.571564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.573090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93e2a9-9e4b-4235-8a7b-022dc533d5a5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.575069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 118/233] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:52 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:52.581213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:52.696212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1a072-121f-4061-a95a-7595a26aaf80 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:52.737634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:52.738317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.738616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.738893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/80e305254b6d46649e778345fb1caca1/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.745410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, user_id=80e305254b6d46649e778345fb1caca1, role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:52.746895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6ff7e-8ce7-4de2-a600-478d30e88c51 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:52.765977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 116/234] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:52 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/80e305254b6d46649e778345fb1caca1/roles/65fa064da25d44d5b45bbdf45796d403 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:52.819018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6f10-61a2-4d86-a9df-63eba2edd86e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.819723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6f10-61a2-4d86-a9df-63eba2edd86e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.819723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b6f10-61a2-4d86-a9df-63eba2edd86e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.820994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 119/235] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:52.826981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f13f-1510-44c7-a6f5-4aebffa8cfdb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:52.827284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f13f-1510-44c7-a6f5-4aebffa8cfdb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:52.827631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f13f-1510-44c7-a6f5-4aebffa8cfdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:52.856401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e774f13f-1510-44c7-a6f5-4aebffa8cfdb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:52.857627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e774f13f-1510-44c7-a6f5-4aebffa8cfdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:52.883750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:52.958098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 117/236] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:53.278287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d3bb-6c75-4caa-8ced-ea16f499914c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.278954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d3bb-6c75-4caa-8ced-ea16f499914c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.279494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37d3bb-6c75-4caa-8ced-ea16f499914c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.281042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 120/237] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:53.286270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb21c-049c-47c1-895b-87a0ca9eeb0e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.286554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb21c-049c-47c1-895b-87a0ca9eeb0e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.286826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ebb21c-049c-47c1-895b-87a0ca9eeb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.315600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-31ebb21c-049c-47c1-895b-87a0ca9eeb0e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:53.317058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-31ebb21c-049c-47c1-895b-87a0ca9eeb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:53.332107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d3bb-6c75-4caa-8ced-ea16f499914c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.444482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 118/238] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:53.488303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.500676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37d3bb-6c75-4caa-8ced-ea16f499914c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.542432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea117-fc8c-4ba8-81fb-1d1b55239bd1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.543164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea117-fc8c-4ba8-81fb-1d1b55239bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.543700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ea117-fc8c-4ba8-81fb-1d1b55239bd1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.545772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 119/239] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:53.551094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.551595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.552078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.563039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.563733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.564019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.564291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.585272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:53.586529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:53.589561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:53.594428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:53.595294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:53.596126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:53.601944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 121/240] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:53.603087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.729042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 120/241] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:53.744529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.769533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2507a-505b-434c-b009-4d742fe84f29 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.808338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.810557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:53.810557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:53.810557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:53.810557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:53.811160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:53.811462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:53.812992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:53.840469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 122/242] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:53.843684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:53.874821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:53.934725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b4246-00fc-4bb4-82f7-6500dd0ec145 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:53.999347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.000009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.000284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.000554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.001856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.004681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.011167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 121/243] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.013804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.046933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fbc9-3fb1-4e21-a954-da2617924821 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.087251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.088285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.088775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.089282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] PATH_INFO: `/v3/users/14aedd53d2ad407685aad3f3549012e0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.104514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] RBAC: Authorizing `identity:get_user(user_id=14aedd53d2ad407685aad3f3549012e0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.106270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.106800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.109531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 123/244] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:53 2022] GET /identity/v3/users/14aedd53d2ad407685aad3f3549012e0 => generated 297 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.110626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.125044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df64a39-eac0-45dd-a425-6761907e2dd6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.162327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.163114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.163392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.163706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.164768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.166220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.190137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 122/245] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:54 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:54.191154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.196294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.263290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc18328-5c1a-434e-9ecf-90a873cbd772 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.351664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.352110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.352392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.352664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.373553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:54.379245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:54.380191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:54.381067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 124/246] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:54.388817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.405236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad959b6-2b3f-4b0e-aeca-56fc220b6b52 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.460576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.461392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.461677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.461950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.478208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.527443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd3cd9-6ad4-435f-b248-82e7dd8e7eb7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.563406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.565220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.570816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.579219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.579988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.580369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.580990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.581540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:54.581929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.583435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.594501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 125/247] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.605918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.707048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 123/248] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:54.715198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.739654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff9645-2202-4bd5-b638-beb7f341c677 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.764149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.777719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.778593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.779041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.779523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] PATH_INFO: `/v3/users/b8b9ca088efe457b9f1ed94bd75335a1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.780900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] RBAC: Authorizing `identity:get_user(user_id=b8b9ca088efe457b9f1ed94bd75335a1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.782574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.789646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 126/249] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/users/b8b9ca088efe457b9f1ed94bd75335a1 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.790820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.841185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa72b4-438c-4407-b23e-9d3654aa3932 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.860122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:54.882123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.883326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.883833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.884101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.885278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.886793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e958d-45b4-4768-918c-5ed0114a9e70 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.888538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 124/250] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.889785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd264c3-2d7e-4baa-b3ee-8aeb558f0243 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.890071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd264c3-2d7e-4baa-b3ee-8aeb558f0243 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.890336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd264c3-2d7e-4baa-b3ee-8aeb558f0243 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.891974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 125/251] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:54.894441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd264c3-2d7e-4baa-b3ee-8aeb558f0243 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:54.915178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7a4f9-8157-429b-bce1-bd2daf93cb7c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:54.952344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:54.953385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.953873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.954348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.955738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:54.957406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287656f-8e78-4b2c-85e7-32c96ba61336 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:54.959866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 127/252] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:54.961442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:54.962047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:54.962523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:54.983805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:54.985665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:55.060587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 128/253] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:55.061747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:55.136332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd264c3-2d7e-4baa-b3ee-8aeb558f0243 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:55.154321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:55.158389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:55.224923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05407c9-b09d-451f-aba6-4300eff798f4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:55.270036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:55.270702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.270978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.271250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/b8b9ca088efe457b9f1ed94bd75335a1/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.274373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, user_id=b8b9ca088efe457b9f1ed94bd75335a1, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:55.275868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a123-d4ed-47fa-a5a7-1eb8d51a3e4a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:55.276203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229b095-3086-439e-bace-a343594b112a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:55.276832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229b095-3086-439e-bace-a343594b112a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.277112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229b095-3086-439e-bace-a343594b112a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.277380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229b095-3086-439e-bace-a343594b112a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.278124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229b095-3086-439e-bace-a343594b112a None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=14aedd53d2ad407685aad3f3549012e0) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:55.278432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229b095-3086-439e-bace-a343594b112a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:55.279922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229b095-3086-439e-bace-a343594b112a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:55.291111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 129/254] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:39:55 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/b8b9ca088efe457b9f1ed94bd75335a1/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:39:55.301801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 126/255] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:54 2022] GET /identity/v3/role_assignments?user.id=14aedd53d2ad407685aad3f3549012e0&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 259 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:55.366509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f139e-fb08-4129-a062-a3da01abbef8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.366922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f139e-fb08-4129-a062-a3da01abbef8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.367134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f139e-fb08-4129-a062-a3da01abbef8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.368970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 130/256] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:55.375091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.375376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.375685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.405371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:55.406512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:55.518483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f139e-fb08-4129-a062-a3da01abbef8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:55.530011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 127/257] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:55.658375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f139e-fb08-4129-a062-a3da01abbef8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:55.685609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:55.707966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:55.709001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.709571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.710102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.721764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:55.727639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:55.728533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:39:55.729315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:55.731949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 131/258] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:55.737947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:55.863916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0642121-25f0-4646-82c6-04d78b185aa0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:55.865568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:55.910219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:55.910745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:55.911016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:55.911280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:55.911973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:55.912270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:55.914422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:55.923118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 128/259] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:55.928636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:55.979435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.105336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db83258-1def-4937-ac28-021ee3de1743 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.132914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ca885-f5f3-4f67-99fe-8943eb5752a0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.144076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.144994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.145467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.145982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.148172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.149955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.152028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 132/260] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:55 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:56.163557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.209049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.211283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.211760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.212649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.238559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:56.245032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:56.246282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:39:56.247297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:56.251516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 129/261] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:39:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:56.257332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.261047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.307373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.370302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a57f2b-5496-462f-8cae-b1091760919f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.419251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffe83-f800-468a-a770-20a1eb1934b1 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.450864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.452978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.453461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.454168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.485668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.486672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.488796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.489266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.491832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:56.492524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.494152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.521372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 130/262] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:56.528508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.559246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.561070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.614756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.681381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.695559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 133/263] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:39:56.700987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.704130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1d2528-0c89-436b-a498-c172ea00084f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.743154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.744678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.745165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.745699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] PATH_INFO: `/v3/users/80e305254b6d46649e778345fb1caca1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.747251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] RBAC: Authorizing `identity:get_user(user_id=80e305254b6d46649e778345fb1caca1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.749141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.751432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 131/264] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/users/80e305254b6d46649e778345fb1caca1 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:56.765162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.809646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61890f7b-4e08-4e63-8a20-b364821a648a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.849299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:56.850555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:56.851038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:56.851038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:56.858660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:56.860140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:56.861990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 134/265] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:56.876345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:56.903909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:56.940967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca277da-284c-4cae-a892-a3af6abb746b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:56.993729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53521ee8-6980-4f61-8b5d-1c6233a5d709 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.032022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.033014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.033524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.033894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.034872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=80e305254b6d46649e778345fb1caca1) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:57.035278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.037129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6278dc-5bcf-4fd4-b15c-609c0bb2b3f9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.044294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 135/266] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/role_assignments?user.id=80e305254b6d46649e778345fb1caca1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:57.056376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.057275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.057723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.058137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.109179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.184757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.186505 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.268229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d420-1e36-4e93-bf05-408445ef2bd1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.268678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d420-1e36-4e93-bf05-408445ef2bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.269147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc43d420-1e36-4e93-bf05-408445ef2bd1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.270740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 136/267] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:57.277145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe10e-6a70-4a33-8c3a-3eaeee3aa021 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.278015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe10e-6a70-4a33-8c3a-3eaeee3aa021 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.278015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbe10e-6a70-4a33-8c3a-3eaeee3aa021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.300741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e7fbe10e-6a70-4a33-8c3a-3eaeee3aa021 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:57.302172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e7fbe10e-6a70-4a33-8c3a-3eaeee3aa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:57.306171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 132/268] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:39:57.312159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.426342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.458964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 137/269] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:39:57.474357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a95a1-65a2-4221-badc-bb8a6a37cae1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.475459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a95a1-65a2-4221-badc-bb8a6a37cae1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.475969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a95a1-65a2-4221-badc-bb8a6a37cae1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.478145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 138/270] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:39:57.483296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.483902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.484416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.508466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:57.510151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:57.523587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec91d05-6210-4476-b408-8776b25bac56 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.523753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:57.594172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 139/271] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:57.619371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.620060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.620339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.620604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.621728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.623164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.624814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 133/272] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:57.630890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.766078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba82c2c-dde2-4bf8-83e3-662642297afa None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:57.805576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:57.806366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:57.806765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:57.807172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:57.808251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=80e305254b6d46649e778345fb1caca1) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:57.808711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:57.811051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:57.820945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 140/273] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/role_assignments?user.id=80e305254b6d46649e778345fb1caca1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:57.875097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.949220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:57.952637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.079303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e772fa1f-5728-472a-ba9e-8e16044ce19e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.135339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.147238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bbba7-f214-4bf5-a431-5e8975a4b747 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.155148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.156258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.156814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.157240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.159991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.161550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.165345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 134/274] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:58.172386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.195571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.196344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.196959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.197299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.212488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:58.218702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:58.220015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:58.220819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 141/275] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:58.228901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.324918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.372982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5634693-aa97-44d9-936c-a3e172b34d3e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.392426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c04f60-c171-4b4a-9e22-22d5349e426f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.423504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.424385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.424657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.424991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.425696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.428390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04517ff-5457-4af7-ac2c-14334a2acea8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.457186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.457818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.458097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.458364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.459710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:58.460214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.461781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.480879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 142/277] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:58.481243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 135/277] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:39:58 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:39:58.490617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.611240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9a056-fb29-4c46-88d1-1f3177a8bd72 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.611704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9a056-fb29-4c46-88d1-1f3177a8bd72 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.611860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9a056-fb29-4c46-88d1-1f3177a8bd72 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.613599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 136/278] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:58.620225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6e553-b570-493c-8948-5aae805cfc08 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.620535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6e553-b570-493c-8948-5aae805cfc08 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.620785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d6e553-b570-493c-8948-5aae805cfc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.644015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-70d6e553-b570-493c-8948-5aae805cfc08 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:58.645169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-70d6e553-b570-493c-8948-5aae805cfc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:58.676116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f38b497-6066-43b0-84d3-5afebbaeb0ca None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.708719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.716494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:58.724964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.725936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.726214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.726965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] PATH_INFO: `/v3/users/df050b40e57a4ba28ea681a8741a269b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.741936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=df050b40e57a4ba28ea681a8741a269b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.743585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92849ea-4a56-4485-899b-1f79ab4e5ab8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.745346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 143/279] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/users/df050b40e57a4ba28ea681a8741a269b => generated 293 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:58.746682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27b56-7893-45c7-af95-b595c7349011 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.746971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27b56-7893-45c7-af95-b595c7349011 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.747248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a27b56-7893-45c7-af95-b595c7349011 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.748570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 144/280] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:39:58.753426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27b56-7893-45c7-af95-b595c7349011 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:58.755513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 137/281] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:58.757109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.757396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.757731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.790999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:39:58.792894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:39:58.897924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 138/282] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:39:58.911117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a27b56-7893-45c7-af95-b595c7349011 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:58.949794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:58.950750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:58.951241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:58.951821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:58.952738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, user.id=df050b40e57a4ba28ea681a8741a269b, scope.system=all) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:58.953234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:58.954852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:58.960882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 145/283] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Aug 24 04:39:58 2022] GET /identity/v3/role_assignments?user.id=df050b40e57a4ba28ea681a8741a269b&scope.system=all&role.id=97c92764f4f344c5a16b60e86473677d => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:59.099683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.223044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761876-d858-4315-8425-7b4b0b68d977 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.228838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.238405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:59.292474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.293756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.294234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.294698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:59.309560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:59.315273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:59.316309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:39:59.317365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:39:59.321101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 139/284] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:39:59.328656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.330937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:59.437958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538ebfa-d39c-4c08-a644-86636ccfc144 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.507057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.507723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.507999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.508265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:59.522630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dee95-afda-4930-b293-09f614cfae5a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.540458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:39:59.545241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:39:59.546130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:39:59.547302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 146/285] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:39:59.554729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.562358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.562973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.563253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.563547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:59.564277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:59.564579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:59.566052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:59.575985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 140/286] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:59.581936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.620435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:59.707439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd350f-4120-4b8e-82f4-b0180909119f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.747380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.748837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.749334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.749821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] PATH_INFO: `/v3/users/b8b9ca088efe457b9f1ed94bd75335a1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:59.751168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] RBAC: Authorizing `identity:get_user(user_id=b8b9ca088efe457b9f1ed94bd75335a1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:59.752976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:59.755405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 141/287] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/users/b8b9ca088efe457b9f1ed94bd75335a1 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:39:59.762298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.777664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d58acc8-3cae-4785-bf78-c65bb30dba3c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.790420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:59.869763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.870418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.870698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.870972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:39:59.873736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:39:59.874144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:39:59.876251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:39:59.880084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:39:59.889647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc9052-5555-41a4-bc0c-e15eed8bbd63 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:39:59.898797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 147/288] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:39:59.904584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:39:59.932009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:39:59.933565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:39:59.933991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:39:59.934507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.021593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.024244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.125663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c711b4-8818-4ea4-bca4-f50a32cb62d7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:00.138703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:00.148298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 142/289] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:00.154666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:00.252964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:00.253529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.253678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.253962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] PATH_INFO: `/v3/users/14aedd53d2ad407685aad3f3549012e0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.255138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] RBAC: Authorizing `identity:get_user(user_id=14aedd53d2ad407685aad3f3549012e0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.257180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.258770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 148/290] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:39:59 2022] GET /identity/v3/users/14aedd53d2ad407685aad3f3549012e0 => generated 297 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:00.263856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefdf31-5d86-40ed-b63e-a9ae50425f98 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:00.264602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:00.300967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:00.301826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.302247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.302661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.305355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.306946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.309607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 143/291] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:00 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:00.315621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:00.373471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:00.395892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:00.433556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d52209-b7a8-436a-ae34-a507005a76c8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:00.471144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:00.472070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.472489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.472901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.473794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=b8b9ca088efe457b9f1ed94bd75335a1) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:00.474242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.476545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.483259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 144/292] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:00 2022] GET /identity/v3/role_assignments?user.id=b8b9ca088efe457b9f1ed94bd75335a1&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=97c92764f4f344c5a16b60e86473677d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:00.555513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0315d94-6204-4303-8a7c-ae3e30659398 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:00.617852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:00.618518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.618800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.619079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.620284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.621791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a2d69-56d1-4485-931d-177e30dc01bd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.623844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 149/293] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:00 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:00.629401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:00.753462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de974a1d-f817-4756-8adc-931c3337500c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:00.788067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:00.796525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:00.797487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.798068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.798586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/14aedd53d2ad407685aad3f3549012e0/roles/b370b1ccd3b34d3a99ebfa0f634f9608` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.800989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, user_id=14aedd53d2ad407685aad3f3549012e0, role_id=b370b1ccd3b34d3a99ebfa0f634f9608)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:00.802666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f0f24-d02d-45d2-8eb2-e637e7591121 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:00.822677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 145/294] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:00 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/users/14aedd53d2ad407685aad3f3549012e0/roles/b370b1ccd3b34d3a99ebfa0f634f9608 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:00.940912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e230-06e7-4fda-8dce-761a8b9ea1bc None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.941237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e230-06e7-4fda-8dce-761a8b9ea1bc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.941719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93e230-06e7-4fda-8dce-761a8b9ea1bc None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.943385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 150/295] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:00.949840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:00.950809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:00.951297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:00.974283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:00.976202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:01.016343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b84760-5085-44c9-975e-24dbb210d66c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.016665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b84760-5085-44c9-975e-24dbb210d66c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.016894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b84760-5085-44c9-975e-24dbb210d66c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.018415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 151/296] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:01.025603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.026044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.027117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.045496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:01.046699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:01.080098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 146/297] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:01.132340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 152/298] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:01.366000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.422762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.466985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.503506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0137a3-a1b4-4a2d-81bf-db534981a5da None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.527898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.555487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.556681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.557508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.558225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.560161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e21581-4b84-48b5-9d14-c761b8e01b59 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.573391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-7c4b0373-c6ae-4026-82be-dfabee40d262 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:01.581203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:01.582315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:01.583368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:01.591543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 147/299] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:01.591543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c32f5-0c96-4856-942c-2b51f48da590 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.591543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c32f5-0c96-4856-942c-2b51f48da590 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.591543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c32f5-0c96-4856-942c-2b51f48da590 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.595977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 148/300] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:01.597160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c32f5-0c96-4856-942c-2b51f48da590 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.611456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.612413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.612692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.612960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.614061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.616356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670bc47b-6dea-4937-9338-2c15bb0d1354 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.618037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 153/301] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:01.619199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.619491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.619772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.639443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:01.640690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:01.717284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 154/302] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:01.718200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.728114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c32f5-0c96-4856-942c-2b51f48da590 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.768906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.770039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.770537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.771024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.771987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:01.772689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.774360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.784013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.785184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 149/303] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:01.792529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:01.843244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:01.854247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aebe58-d7ee-4002-b130-ce6fb62f01fc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.895399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.896027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.896335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.897160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] PATH_INFO: `/v3/groups` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.897896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.899386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.918798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9501e-a855-438e-970e-4fbfd84f0427 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:01.919192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 155/304] 10.222.0.85 () {60 vars in 1134 bytes} [Wed Aug 24 04:40:01 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:01.970970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:01.972408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:01.972958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:01.973443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] PATH_INFO: `/v3/users/37bde2d003584aa0b7aed760c15f8946` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:01.993472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] RBAC: Authorizing `identity:get_user(user_id=37bde2d003584aa0b7aed760c15f8946)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:01.995645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:01.998383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 150/305] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:01 2022] GET /identity/v3/users/37bde2d003584aa0b7aed760c15f8946 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:02.005380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.025233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.130449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.144358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.145252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7788c-4661-49ed-803e-353307446096 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.149584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5012d1d2-ef5b-4b5c-8f80-342c7fd2be58 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.190980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.191908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.192178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.192450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.193665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.194545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.194825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.195508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.196362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, user.id=37bde2d003584aa0b7aed760c15f8946, scope.system=all) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:02.196671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.198473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.203696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:02.204601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 156/306] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/role_assignments?user.id=37bde2d003584aa0b7aed760c15f8946&scope.system=all&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:02.208932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:02.209933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:02.210718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 151/307] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:02.221316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.346732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146ae13-dda1-4eae-9e8d-0bd9ccb86c30 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.386016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.386813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.387096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.387364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.388123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:02.388430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.389792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.400241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 157/308] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:02.405397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.522341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49bf32-9074-49d6-8886-1e4107990f66 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.563498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.564123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.564398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.564664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] PATH_INFO: `/v3/users/df050b40e57a4ba28ea681a8741a269b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.565792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=df050b40e57a4ba28ea681a8741a269b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.567502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d444b48b-bf53-43d2-9e24-ed01c9053ad0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.569314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 152/309] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:02 2022] GET /identity/v3/users/df050b40e57a4ba28ea681a8741a269b => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:02.575255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:02.596233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:02.684155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916e766-95b4-4dc4-909e-b847576c5570 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:02.719969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:02.720618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.720895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.721166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] PATH_INFO: `/v3/system/users/df050b40e57a4ba28ea681a8741a269b/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.722661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=df050b40e57a4ba28ea681a8741a269b, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:02.724062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec38442-3297-4881-8327-749cf8bff4c6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:02.739928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 158/310] 10.222.0.85 () {58 vars in 1334 bytes} [Wed Aug 24 04:40:02 2022] PUT /identity/v3/system/users/df050b40e57a4ba28ea681a8741a269b/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:02.944463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaad5e5-90c9-40e5-a204-21ce4f2cd391 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.944644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaad5e5-90c9-40e5-a204-21ce4f2cd391 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.944922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaad5e5-90c9-40e5-a204-21ce4f2cd391 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.946289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 153/311] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:02.951734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:02.952028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:02.952307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:02.970987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:02.972213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:03.052843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 159/312] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:03.332161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaad5e5-90c9-40e5-a204-21ce4f2cd391 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:03.364790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:03.464805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaad5e5-90c9-40e5-a204-21ce4f2cd391 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:03.506965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:03.507642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:03.507920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:03.508187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:03.521985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:03.527159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:03.528066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:03.528878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 154/313] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:03.538652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:03.562046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:03.656933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7c952-dd29-41f7-95b5-d82460c9a41d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:03.695442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:03.696081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:03.696354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:03.696622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:03.697292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:03.697588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:03.698971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:03.708469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 160/314] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:03.716649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:03.827859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:03.845595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cab670-e6ae-4080-ac2b-8ea19c36e375 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:03.886154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:03.886817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:03.887090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:03.887361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] PATH_INFO: `/v3/users/14aedd53d2ad407685aad3f3549012e0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:03.888524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] RBAC: Authorizing `identity:get_user(user_id=14aedd53d2ad407685aad3f3549012e0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:03.890014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088db7c-183f-433b-92a8-64fbcf2edb07 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:03.892099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 155/315] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:03 2022] GET /identity/v3/users/14aedd53d2ad407685aad3f3549012e0 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:03.901041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:03.980490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719d71-0fa7-4096-90c3-95c9a998f205 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:03.980718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719d71-0fa7-4096-90c3-95c9a998f205 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:03.981013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3719d71-0fa7-4096-90c3-95c9a998f205 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:03.982524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 156/316] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:03.989380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078de25-6ad5-4459-b65a-1d44b31a883e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:03.989762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078de25-6ad5-4459-b65a-1d44b31a883e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:03.990950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078de25-6ad5-4459-b65a-1d44b31a883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.011742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8078de25-6ad5-4459-b65a-1d44b31a883e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:04.013207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8078de25-6ad5-4459-b65a-1d44b31a883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:04.042956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:04.075650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d8d99-75bc-427d-a26b-ab630434ac61 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:04.107597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 157/317] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:04.124785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:04.125406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.125766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.126041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.210709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:04.212215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:04.332011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:04.339999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7174a0-7b9a-4afe-893a-7085a6eb7fa1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.340742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7174a0-7b9a-4afe-893a-7085a6eb7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.340742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7174a0-7b9a-4afe-893a-7085a6eb7fa1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.342228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 158/318] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:04.353302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.354333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.355103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.364572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 161/319] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:04.377304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:04.382521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:04.384461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:04.497876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 159/320] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:04.507172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:04.529817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:04.543111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc731ad9-5e18-4321-b8b2-9c08feee53ac None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:04.631790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:04.632420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.632706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.632979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.634254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:04.635784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:04.637818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 162/321] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:04 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:04.643375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:04.659423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a9c51-a100-4621-9f82-f9f65c4268d8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:04.697199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:04.722989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:04.723560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.723846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.724122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.725980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:04.727629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:04.733960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 160/322] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:04.741545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:04.785928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab3efb-281c-4801-9748-17d0365dd16b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:04.835916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:04.836533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.836811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.837084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.855651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, scope.project.id=8a93c797804e4fcf803d5beab9da8d14, user.id=14aedd53d2ad407685aad3f3549012e0) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:04.855651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:04.855651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:04.855651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 163/323] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:04 2022] GET /identity/v3/role_assignments?user.id=14aedd53d2ad407685aad3f3549012e0&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:04.855651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:04.866295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:04.891769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec8e80-3367-4f4b-80a9-9a714d7b7604 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:04.933458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:04.934110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.934387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.934660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] PATH_INFO: `/v3/groups` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.935328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:04.936883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8595ddec-321d-4088-b255-39f9bd3fe1bd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:04.960136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 161/324] 10.222.0.85 () {60 vars in 1134 bytes} [Wed Aug 24 04:40:04 2022] POST /identity/v3/groups => generated 226 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:04.960136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91753a3-a77f-4c15-be74-b1aa1e4f884d None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.960136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91753a3-a77f-4c15-be74-b1aa1e4f884d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.960136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91753a3-a77f-4c15-be74-b1aa1e4f884d None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.960136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 162/325] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:04.971520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:04.971520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:04.971520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:04.994870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200b1b7-3e37-4012-aa5f-f533b9997955 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.003592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.006349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:05.008490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:05.054862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.055553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.055861 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.056104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.084924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:05.091527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:05.092488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:05.093267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:05.094449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 164/326] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:05.098658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.149886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 163/327] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:05.232763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f18b7-2081-4359-9093-7dd70747c33d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.282286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.283273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.283580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.283859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.284539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:05.285258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.286225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.298862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 165/328] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:05.305885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.398775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.431353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.442152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6640ed86-4072-4ace-8ab2-86e23a949f60 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.493575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.507402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.508447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.508915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.509380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] PATH_INFO: `/v3/users/37bde2d003584aa0b7aed760c15f8946` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.510853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] RBAC: Authorizing `identity:get_user(user_id=37bde2d003584aa0b7aed760c15f8946)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.512616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.514447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 164/329] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/users/37bde2d003584aa0b7aed760c15f8946 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:05.524138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.639118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc0e5-0392-42eb-ae95-36bd43865ad4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.686952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282c6df-9e71-4049-8d3b-54dd927695a3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.697254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.698197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.698579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.699122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.714511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:05.720297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:05.722048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:05.723670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 166/330] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:05.728702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.768142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27531f72-1297-45af-a563-57f041caff98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.768814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531f72-1297-45af-a563-57f041caff98 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.769092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531f72-1297-45af-a563-57f041caff98 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.769353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27531f72-1297-45af-a563-57f041caff98 None admin] PATH_INFO: `/v3/system/users/37bde2d003584aa0b7aed760c15f8946/roles/b370b1ccd3b34d3a99ebfa0f634f9608` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.772448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27531f72-1297-45af-a563-57f041caff98 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37bde2d003584aa0b7aed760c15f8946, role_id=b370b1ccd3b34d3a99ebfa0f634f9608)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.773860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27531f72-1297-45af-a563-57f041caff98 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.793723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 165/331] 10.222.0.85 () {58 vars in 1334 bytes} [Wed Aug 24 04:40:05 2022] PUT /identity/v3/system/users/37bde2d003584aa0b7aed760c15f8946/roles/b370b1ccd3b34d3a99ebfa0f634f9608 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:05.891222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:05.907657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d465bc7-8e3a-41d8-8e03-996683dbd9bf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:05.949002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:05.949621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:05.949908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:05.950187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:05.950891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:05.951197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:05.952770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:05.964334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 167/332] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:05.969702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27531f72-1297-45af-a563-57f041caff98 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:05.974085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:06.117045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27531f72-1297-45af-a563-57f041caff98 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.155777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.156425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.156708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.156979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] PATH_INFO: `/v3/users/df050b40e57a4ba28ea681a8741a269b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.158178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] RBAC: Authorizing `identity:get_user(user_id=df050b40e57a4ba28ea681a8741a269b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.159679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181e851a-54e1-40b4-aafb-4d4d45159127 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.161308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 166/333] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:05 2022] GET /identity/v3/users/df050b40e57a4ba28ea681a8741a269b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:06.168295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:06.308674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821429c0-4819-4945-9aaf-4023dd1fd6a6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:06.352645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:06.353364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:06.353642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:06.353895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:06.354623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] RBAC: Adding query filter params (role.id=97c92764f4f344c5a16b60e86473677d, user.id=df050b40e57a4ba28ea681a8741a269b, scope.system=all) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:06.354925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:06.356476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1141f789-7a89-40b6-acee-bab7e317daf4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:06.376542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 168/334] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Aug 24 04:40:06 2022] GET /identity/v3/role_assignments?user.id=df050b40e57a4ba28ea681a8741a269b&scope.system=all&role.id=97c92764f4f344c5a16b60e86473677d => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:07.373468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7667-c8cc-4e27-a2fc-078cfbc4b4cd None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:07.373974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7667-c8cc-4e27-a2fc-078cfbc4b4cd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:07.374263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f7667-c8cc-4e27-a2fc-078cfbc4b4cd None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:07.375591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 167/335] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:07.382164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:07.383058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:07.383553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:07.408449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:07.409948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:07.413587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:07.509274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 169/336] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:08.011502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7667-c8cc-4e27-a2fc-078cfbc4b4cd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:08.107556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:08.146700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f7667-c8cc-4e27-a2fc-078cfbc4b4cd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:08.190029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f534-8997-406e-8335-7f0943751624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:08.190665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f534-8997-406e-8335-7f0943751624 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.190933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f534-8997-406e-8335-7f0943751624 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.191541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1135f534-8997-406e-8335-7f0943751624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.210313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1135f534-8997-406e-8335-7f0943751624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-1135f534-8997-406e-8335-7f0943751624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:08.215414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:08.216379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:08.217210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:08.218944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 168/337] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:08.222730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:08.370761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0f9ec-cbad-4d1c-b519-c3b2db2ff2e3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:08.415311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:08.415950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.416216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.416486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.417158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:08.417452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:08.418817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4657c1e-d1a4-446b-8f92-b03f4d555e23 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:08.427887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:08.432366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 170/338] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:08.438034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f534-8997-406e-8335-7f0943751624 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:08.612575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1135f534-8997-406e-8335-7f0943751624 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:08.636140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb06e-ee2c-47ab-84da-275f3b65ad5b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.636339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb06e-ee2c-47ab-84da-275f3b65ad5b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.636618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252eb06e-ee2c-47ab-84da-275f3b65ad5b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.638155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 171/339] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:08.645905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5026e-8d5f-47ef-ad34-5e785bb45eca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.645905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5026e-8d5f-47ef-ad34-5e785bb45eca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.645905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5026e-8d5f-47ef-ad34-5e785bb45eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.658974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:08.665873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:08.666488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.666762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.667141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.671398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3fb5026e-8d5f-47ef-ad34-5e785bb45eca None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:08.672854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3fb5026e-8d5f-47ef-ad34-5e785bb45eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:08.753313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 172/340] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:08.815555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:08.817270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:08.902303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4e14-1b34-4409-b22c-0ab13e95a136 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.902580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4e14-1b34-4409-b22c-0ab13e95a136 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.902762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c4e14-1b34-4409-b22c-0ab13e95a136 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.904689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 173/341] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:08.910165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:08.910626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:08.911021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:08.949831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 169/342] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:08.951036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:08.953925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:08.955092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:08.988649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.069418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e3e37-e3df-4a91-8a7c-a082ba71160d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.113312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 174/343] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:09.115172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.116745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.117193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.117624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.119113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:09.120814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:09.123066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 170/344] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:08 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:09.128254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.222341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.232045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.289200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59416c1-3e92-422e-97f5-76f50c538fae None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.352807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.353458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.353736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.354009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.372207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:09.373676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474199b6-c395-47b7-8c4d-e3bfdff10ccb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:09.375735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 175/345] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:09.376962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a58-dc8f-419f-8222-3be42f12ee10 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.377242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a58-dc8f-419f-8222-3be42f12ee10 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.377580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a801a58-dc8f-419f-8222-3be42f12ee10 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.378790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 176/346] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:09.385219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.385583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.385762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.420472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:09.421494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.421669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:09.425156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3c7ed-f49d-4e40-8c6a-034de44165de None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.466398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.467923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.468423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.468921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.482300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:09.490498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:09.491354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:09.492173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:09.495282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 171/347] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:09.496648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.588328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 177/348] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:09.589550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.649058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d27840-6750-4eaf-8589-c4d571692ed0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.690844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.695566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.696367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.696650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.697274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.698287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=b84e078154c949168ec4bafbe86e7a15) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:09.698604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:09.700608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c9441-b19b-4e04-be54-78e8d6756ae5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:09.708437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 172/349] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=97c92764f4f344c5a16b60e86473677d => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:09.709729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93ab3-5a87-4c1b-a3a8-a42fd6a6d98f None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.711495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93ab3-5a87-4c1b-a3a8-a42fd6a6d98f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.716632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee93ab3-5a87-4c1b-a3a8-a42fd6a6d98f None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.718718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 173/350] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:09.719557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93ab3-5a87-4c1b-a3a8-a42fd6a6d98f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:09.762095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a86789-a3db-4fc6-9767-e281bf2d0648 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.781951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:09.853600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.854278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.854556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.854822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.855521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:09.855824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:09.857391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3b0066-2741-499c-a24f-c767fe4548d3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:09.877309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 178/351] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:09.878674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.878962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.879238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.891265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee93ab3-5a87-4c1b-a3a8-a42fd6a6d98f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:09.911099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:09.913327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:09.937285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:09.938254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:09.938531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:09.938802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:09.952487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:09.957453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:09.960543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 174/352] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:09.962726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.031575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 179/353] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:10.031575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.100737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.115462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529c07d-6141-4e03-8ca7-256cf68ebaba None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.120435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.183177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.184070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.184794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.185070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.187246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14daeb6a-cc11-46b2-8527-acd3d3c0afcf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.251020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.251728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.252000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.252265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.269373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:10.273235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.274747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a5c3b0-1deb-4836-bba2-9536328602b2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:10.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:10.276221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:10.276982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 180/354] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:10.278187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.397403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.419833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6deb7a-4088-433f-b817-2f422bf84279 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.422164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 175/355] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:10.423933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebf34-4007-4a59-a15f-6ff12b3760f6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.424561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebf34-4007-4a59-a15f-6ff12b3760f6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.425030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ebf34-4007-4a59-a15f-6ff12b3760f6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.426911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 176/356] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:10.428954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ebf34-4007-4a59-a15f-6ff12b3760f6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.429375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.467783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.468425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.468807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.469430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.469852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:10.470162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.473339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.486483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 181/357] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:10.486483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.598841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ebf34-4007-4a59-a15f-6ff12b3760f6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.650597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.651261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.651648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.651989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.652690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:10.653058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.654493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.665166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 177/358] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:10.665863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.679221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc34612-750d-4cea-9ea7-13a6e8c5752b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.726021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.727036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.727665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.728152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.729543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.741861 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6af37941-1644-4472-a44f-5088d7849ec8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:10.747680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:10.748621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:10.749533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 182/359] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:10.750208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.750337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.750608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.772368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:10.773615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:10.808881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:10.843152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d70caf-6387-420b-9d58-c50e48aad2fe None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:10.872923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 183/360] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:10.873800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:10.904454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:10.905740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:10.906222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:10.907131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:10.909136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:10.911790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:10.915768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 178/361] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:10.917861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.012497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f998cb89-c4b4-43bf-a062-09e659324019 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.054263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.055282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.055799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.056282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.067106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0778a7b5-0120-4775-a783-cfc26c33b0e7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.091859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.109508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.173008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.173593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.173876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.174153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] PATH_INFO: `/v3/users/37bde2d003584aa0b7aed760c15f8946` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.175619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] RBAC: Authorizing `identity:get_user(user_id=37bde2d003584aa0b7aed760c15f8946)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.177732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.179723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 179/362] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/users/37bde2d003584aa0b7aed760c15f8946 => generated 293 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:11.184468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.190843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.194119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.347994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9226df22-9458-48c1-aa11-341cb22a512f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.360969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 184/363] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:11.361906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.407189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.407850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.408123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.408390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.409454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:11.409454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.410729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.424934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 180/364] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:11.425790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.445226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.501104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.517880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448655c7-5c7a-48f6-8f5e-e95eaeb67fdf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.568846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.569704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.570176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.570522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.572103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.573639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.575255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 185/365] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:11.576083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.596338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b4dc3d-5253-4280-a1eb-bd38a7424933 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.664694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.665625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.665625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.665860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.666677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] RBAC: Adding query filter params (role.id=b370b1ccd3b34d3a99ebfa0f634f9608, user.id=37bde2d003584aa0b7aed760c15f8946, scope.system=all) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:11.666989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.668867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.684898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 181/366] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/role_assignments?user.id=37bde2d003584aa0b7aed760c15f8946&scope.system=all&role.id=b370b1ccd3b34d3a99ebfa0f634f9608 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:11.685742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.760383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4076f42b-e412-4a86-bd41-a98e7323694d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.811446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.831840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.833120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.834333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.834942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.848263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35404d7e-31a6-4ca2-9ce7-b09907e1f05e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:11.850523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:11.858492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:11.867977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:11.869044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:11.869875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:11.870943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 186/367] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:11.875910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:11.905470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:11.907225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:11.908049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:11.908524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:11.910368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:11.915320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:11.915964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 182/368] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:11.917015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.069078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4de36-3864-4f4c-ab2f-13c6b3da81dc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.087222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c50431-9f5b-4ec3-9a22-788e4eff6f41 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.125068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.126049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.126487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.126946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.157137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.157749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.158052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.158327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.159015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=b84e078154c949168ec4bafbe86e7a15) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:12.159322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.161045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.169851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 183/369] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 260 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:12.171866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.226959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.249178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.250152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.251957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.359433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d78ae-f42b-4b64-a008-fa07259cca4e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.403030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 187/370] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:12.403951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.413146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.414161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.414503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.414869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.415613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:12.415922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.417316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8027b38-9b06-4d92-a91b-8637349e0d19 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.426771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 184/371] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:12.429002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8e349-f7f2-47d0-8587-00ba53d7eed4 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.429283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8e349-f7f2-47d0-8587-00ba53d7eed4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.429560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8e349-f7f2-47d0-8587-00ba53d7eed4 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.430992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 185/372] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:12.431678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8e349-f7f2-47d0-8587-00ba53d7eed4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.551703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.574779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98214a74-4550-4176-ab9a-41ff2fd811f6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.619142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.630917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8e349-f7f2-47d0-8587-00ba53d7eed4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.643855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.643855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.644134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.644364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.645548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.647180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.649036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 188/373] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:12 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:12.654088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.696246 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.697293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.697785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.698350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.701916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.704692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b2a72-887d-4e50-a64c-1090cd8d8167 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.712366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 186/374] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:12 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:12.712366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.712366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.712366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.738744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:12.740185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:12.809695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478f9f0-19ea-4d47-9776-214f96696a53 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.846212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 187/375] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:12.848064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:12.869287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:12.870261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:12.870261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:12.870261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:12.917283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:12.976920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a7a5a-7b5d-4e6d-8efd-e6596f2f343b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:12.982552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:12.984145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:12.995946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:13.032249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.033254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.033751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.034212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.035146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=8a93c797804e4fcf803d5beab9da8d14) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:13.035490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.037868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.049641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 188/376] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:12 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=97c92764f4f344c5a16b60e86473677d => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:13.050516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.196780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 189/377] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:13.200763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.268022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380bd2-8c39-4569-a83b-f43ece938f7e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.284437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:13.319087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.319759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.320039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.320308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.321800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.324141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.326269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 189/378] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:13.327067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.345103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac27334c-aed3-498c-b871-431fffd69fef None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.364840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:13.401469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.402112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.402386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.402659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] PATH_INFO: `/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.406379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] RBAC: Authorizing `identity:get_project(project_id=aa9562368e9a4def85d52ce0d60bc9dc)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.407858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.409727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 190/379] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:13.410669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.488738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd35ddf-25a2-4da3-a425-aa3c776d7ebc None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.530560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.531614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.532131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.532657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.546521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:13.552953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:13.553849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:13.554629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:13.556287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85da71b-5fbe-414e-9c2d-b5ffc6e9d897 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.559432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 190/380] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:13.560141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.599334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:13.619440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.621311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.621841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.622335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.623279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=8a93c797804e4fcf803d5beab9da8d14) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:13.623810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.626099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.635175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 191/381] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:13.637124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.686301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:13.707565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46f47e-2192-4cad-ae9e-574d6eff599f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.752902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.754029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.754511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.755084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] PATH_INFO: `/v3/groups/85d9b65ee0394a028a80925a9a92c5ed` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.762858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] RBAC: Authorizing `identity:get_group(group_id=85d9b65ee0394a028a80925a9a92c5ed)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.764767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.767092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 191/382] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/groups/85d9b65ee0394a028a80925a9a92c5ed => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:13.774206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:13.898137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2ea5ca-9ab0-46be-816b-8cff8831e8fc None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:13.938273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:13.939269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:13.939776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:13.940245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:13.941458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] RBAC: Adding query filter params (group.id=85d9b65ee0394a028a80925a9a92c5ed, role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=aa9562368e9a4def85d52ce0d60bc9dc) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:13.941963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:13.944327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:13.951369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 192/383] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/role_assignments?group.id=85d9b65ee0394a028a80925a9a92c5ed&scope.project.id=aa9562368e9a4def85d52ce0d60bc9dc&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:13.967481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944bef4-aca0-43b4-b15a-a2339bb42489 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:14.046295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:14.047394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.047970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.048501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.049455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:14.049976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:14.051630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:14.069207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 192/384] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:14.077619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:14.101513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:14.235809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fb4c0e-a59e-466a-a597-b0602e5d1e37 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:14.276435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:14.277084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.277406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.277690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.278919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:14.280392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:14.282433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 193/385] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:14 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:14.290704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:14.380209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:14.447333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438617de-cd62-46ee-ba70-9f34385296e4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:14.485252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:14.486277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.486277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.486407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.487596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:14.489033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c783-a449-4b7d-8e42-8cee28994605 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:14.491696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 193/386] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:14 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:14.500918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:14.612561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04791b-a851-49b0-a0c5-31872adc758a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.613329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04791b-a851-49b0-a0c5-31872adc758a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.613329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04791b-a851-49b0-a0c5-31872adc758a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.623619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 194/387] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:14.626457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.626957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.627430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.669558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:14.671616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:14.672743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:14.695720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88594f-9041-4bee-bab2-2b7f134ce01c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:14.762819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:14.763529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:14.767494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:14.767494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/groups/5db9e47d09514bd284fb229016310c84/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:14.767494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, group_id=5db9e47d09514bd284fb229016310c84, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:14.768891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:14.794473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 194/388] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Aug 24 04:40:14 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/groups/5db9e47d09514bd284fb229016310c84/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:14.822131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 195/389] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:15.261344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.413907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f27ac3-4738-4504-812e-36edc0990620 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.464707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.465373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.465656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.465936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.478147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:15.487870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:15.488746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:15.491123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 195/390] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:15.499373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.603416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:15.694467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cbcb1-1aca-49cf-a849-e3fe18067238 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.741450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.742067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.742347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.742617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.743292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:15.743618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.745001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da74658-3b0f-4fd1-bfa3-d3319b0142c9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.759085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 196/391] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:15.765140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:15.768136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:15.850490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44fad-edf1-4122-900e-910fc6550d8d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.850831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44fad-edf1-4122-900e-910fc6550d8d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.851042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e44fad-edf1-4122-900e-910fc6550d8d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.852424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 197/392] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:15.858257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.858515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.858723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.897750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d593d9-ac5c-4621-b419-a3298c7b20c6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:15.900622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:15.901919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:15.939771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:15.940482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:15.941035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:15.941325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:15.943503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:15.945093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:15.947261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 196/393] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:15.953708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:16.081212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 198/394] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:16.089921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:16.154399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2068c-b425-4f30-a374-d2711ba10d58 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:16.193922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:16.194683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.194971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.195249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.196439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:16.197904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d513f5d-8b0b-489c-bae8-1718d40b9bc6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:16.199906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 197/395] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:15 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:16.205674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:16.256875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:16.325452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc79-f41c-4c92-b8d3-afc131ed2edd None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.325772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc79-f41c-4c92-b8d3-afc131ed2edd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.325995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767fc79-f41c-4c92-b8d3-afc131ed2edd None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.327734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 198/396] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:16.333141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c138-a734-4914-8f12-aca7ebad6a2d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.333564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c138-a734-4914-8f12-aca7ebad6a2d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.334051 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2c138-a734-4914-8f12-aca7ebad6a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.354017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-81d2c138-a734-4914-8f12-aca7ebad6a2d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:16.355229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-81d2c138-a734-4914-8f12-aca7ebad6a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:16.360762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f684fd-d2d1-4091-86c8-fa954b553a26 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:16.433916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:16.434648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.434929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.435198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15/groups/5db9e47d09514bd284fb229016310c84/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.437613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] RBAC: Authorizing `identity:create_grant(project_id=b84e078154c949168ec4bafbe86e7a15, group_id=5db9e47d09514bd284fb229016310c84, role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:16.439783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:16.462042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 199/397] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Aug 24 04:40:16 2022] PUT /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15/groups/5db9e47d09514bd284fb229016310c84/roles/65fa064da25d44d5b45bbdf45796d403 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:16.462923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:16.478989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 199/398] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:16.480783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2fa0-faa1-40e1-9cc5-8c36a08cad74 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.481298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2fa0-faa1-40e1-9cc5-8c36a08cad74 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.481751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e2fa0-faa1-40e1-9cc5-8c36a08cad74 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.483313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 200/399] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:16.497642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.498336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.499042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.540764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:16.542016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:16.655827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:16.661855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75bc085-366d-4f1b-84e5-78e30598bc73 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:16.663546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:16.676092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 201/400] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:16.715506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:16.716062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.716557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.717030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.730700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:16.736428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:16.737566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:16.738800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:16.741966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 200/401] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:16.748029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:16.845199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:16.883444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f49bd3-dcec-4085-8aa2-19f36fa5eba3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:16.928518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:16.929281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:16.929557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:16.929821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:16.930510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:16.930809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:16.932468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:16.954993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 202/402] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:16.963245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.033889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fc059c-2518-4a64-ba6c-263684de6f23 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.095735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.096745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.097209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.097648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.116191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:17.120122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:17.126192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:17.128161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 201/403] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:17.130601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.164054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.206981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72479699-b708-4ad9-a31f-5c7d74254000 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.277001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.278624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.279311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.279957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.280614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13f7e-47e5-4713-aa0f-ada0aca14876 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.283003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.286775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.298207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 203/404] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:16 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:17.300351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.332278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.333034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.333371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.333599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.349221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:17.356455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:17.357585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 202/405] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:17.359237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.474543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.475667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e500d-832c-477f-b5fd-e8b8736cff6a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.512360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.522423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53814c05-afa6-4f5e-ae80-bd86af7b0f13 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.523765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.524396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.524704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.524980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.525657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:17.525968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.527670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.537463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 204/406] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:17.537739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.579088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.579921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.580200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.580472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.582048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.585392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.588191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 203/407] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:17.589786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.673811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59941e24-2bd7-4c67-b0d7-16c58286dd8b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.721667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.722288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.722564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.722840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.723699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:17.724009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.725413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947d651-b123-454d-8bb6-a12889db8328 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.733749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dfc695-434b-4095-8e55-bed1f03c498b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.734276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 205/408] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:17.735636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e86b0-e5b0-4385-bab5-d3ef2e854044 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.735920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e86b0-e5b0-4385-bab5-d3ef2e854044 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.736192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e86b0-e5b0-4385-bab5-d3ef2e854044 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.739714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 206/409] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:17.739714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e86b0-e5b0-4385-bab5-d3ef2e854044 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.782130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.782771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.783050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.783322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.784502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.786635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.788471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 204/410] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:17.789025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:17.811952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.813645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:17.874116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e86b0-e5b0-4385-bab5-d3ef2e854044 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.915327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.916011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.916283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.916552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/groups/5db9e47d09514bd284fb229016310c84/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.918461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, group_id=5db9e47d09514bd284fb229016310c84, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.919920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d374918-f283-4c18-85bb-4ff31d847c37 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.922296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f822d-8b31-4151-8e1d-4b35fb218804 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:17.946064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 207/411] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Aug 24 04:40:17 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/groups/5db9e47d09514bd284fb229016310c84/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:17.946064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.946064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.946064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.962042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:17.963289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:17.976673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:17.977612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:17.978072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:17.978357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] PATH_INFO: `/v3/groups/85d9b65ee0394a028a80925a9a92c5ed` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:17.979703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] RBAC: Authorizing `identity:get_group(group_id=85d9b65ee0394a028a80925a9a92c5ed)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:17.981545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:17.983449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 205/412] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/groups/85d9b65ee0394a028a80925a9a92c5ed => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:17.988557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.048601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 208/413] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:18.049322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.136423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.145447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.174255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd0d5e-2bae-4a1c-aaf0-d8eeb36d19f2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.215112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55ce72-dd32-4166-82b9-19dae36a8ee2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.219844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.220656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.221082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.221526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.222838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.225266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.230957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 206/414] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:17 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:18.237036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.286012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.287112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.287654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.288104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] PATH_INFO: `/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.290413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] RBAC: Authorizing `identity:get_project(project_id=aa9562368e9a4def85d52ce0d60bc9dc)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.294852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.296807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 209/415] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:18 2022] GET /identity/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:18.303383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.417903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7979653f-e94b-4cae-a13b-0b331f471fb4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.454974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3651b0-3959-4121-99af-a4e06ead16bd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.460224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.461142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.461622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.462134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14/groups/5db9e47d09514bd284fb229016310c84/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.465687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a93c797804e4fcf803d5beab9da8d14, group_id=5db9e47d09514bd284fb229016310c84, role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.467211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.469003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.497006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 207/416] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Aug 24 04:40:18 2022] PUT /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14/groups/5db9e47d09514bd284fb229016310c84/roles/65fa064da25d44d5b45bbdf45796d403 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:18.497006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.515653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.517636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.518873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.519258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] PATH_INFO: `/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc/groups/85d9b65ee0394a028a80925a9a92c5ed/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.523524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa9562368e9a4def85d52ce0d60bc9dc, group_id=85d9b65ee0394a028a80925a9a92c5ed, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.525335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.529415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.548694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 210/417] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Aug 24 04:40:18 2022] PUT /identity/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc/groups/85d9b65ee0394a028a80925a9a92c5ed/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:18.681645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd24df7-5690-4ad1-97ff-0d85614f3fd6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.724482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.725149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.725428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.725700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.737407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-30312297-be47-4543-ad01-c3d16551cf12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:18.743561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:18.744531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:18.745323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 208/418] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:18.750737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:18.813350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50024bf9-b1cf-4a5b-95b2-bf4009380da0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.813644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50024bf9-b1cf-4a5b-95b2-bf4009380da0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.813908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50024bf9-b1cf-4a5b-95b2-bf4009380da0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.815600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 209/419] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:18.821737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.822099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.822406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.845968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:18.847323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:18.889413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c3c0d-4f00-4bba-a5b6-8d65b085d373 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:18.951191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:18.951818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:18.952043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:18.952299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:18.954299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:18.954604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:18.956902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:18.957426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:18.966241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 210/420] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:18.971994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 211/421] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:18.978379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.118663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819f342a-c56f-4603-974b-960f5b62c8a1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:19.155272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:19.155919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:19.156198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:19.156470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:19.244706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:19.247833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:19.249833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:19.356321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.412877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:19.421377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 211/422] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:19.425350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.544978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fa91b-ab4b-47a7-934f-2eb1ee53ac96 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:19.589718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:19.591285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:19.591611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:19.591888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:19.607090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:19.613823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:19.615441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:19.616259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:19.620384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 212/423] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:19.622236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.646630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:19.651054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5743f-2f1a-4b2f-9b71-a11f048f186a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:19.747906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:19.749381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:19.749856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:19.750327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:19.756507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:19.758310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:19.759406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:19.760787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 212/424] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:19 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:19.765778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.783488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca955f9-d97d-47db-bd50-d96114058cc4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:19.871904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:19.872430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:19.873015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:19.873169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:19.873798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:19.874124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:19.876507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:19.891185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 213/425] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:19.900566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:19.936035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef8a00-b6de-4747-8768-ff3e20aa8374 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.014676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:20.015323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.018374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.018374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.023183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:20.024941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:20.026825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 213/426] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:19 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:20.034950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:20.097308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954bba4-a999-4f0b-86e5-7fc16d40f7ee None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.104526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:20.166588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:20.167442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.167874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.168283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.213320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:20.229399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82d5a7-257d-41cc-884e-f83ec265842e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.293562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:20.294413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.294835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.295308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.296425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=b84e078154c949168ec4bafbe86e7a15) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:20.296882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:20.298459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:20.306539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 214/427] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:20 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=97c92764f4f344c5a16b60e86473677d => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:20.311437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:20.311437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89907e48-60c3-4d7a-a283-31c3344ae0e9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:20.468212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 214/428] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:40:20.471254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:20.565267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730438-eee6-426d-9406-58175fc7bf90 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.565855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730438-eee6-426d-9406-58175fc7bf90 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.566160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be730438-eee6-426d-9406-58175fc7bf90 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.568684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 215/429] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:20.579460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.579782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.580046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.587722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:20.591994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0babfe-94ee-4364-8db7-785e2d81ca4b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.602027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:20.603281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:20.638171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:20.638817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.639098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.639372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] PATH_INFO: `/v3/projects/b84e078154c949168ec4bafbe86e7a15` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.640900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] RBAC: Authorizing `identity:get_project(project_id=b84e078154c949168ec4bafbe86e7a15)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:20.642501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:20.644810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 215/430] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:20 2022] GET /identity/v3/projects/b84e078154c949168ec4bafbe86e7a15 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:20.657408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:20.680278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:20.715567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 216/431] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:20.785682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba15143-4cf0-4188-a248-7b5d3bb48a93 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.823990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:20.824631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.824960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.825237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.826365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:20.827894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2818e1-e201-4b5a-bef8-31a05a827705 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:20.829769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 216/432] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:20 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:20.836606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:20.940462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb21b3-0b19-4cc7-89d3-298f5902e03b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.941046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb21b3-0b19-4cc7-89d3-298f5902e03b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.941274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb21b3-0b19-4cc7-89d3-298f5902e03b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.944547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 217/433] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:20.949676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:20.950222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:20.950687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:20.968722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1526483-bc9c-4483-abce-6e0d1c2b6b29 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:20.975857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:20.977415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:21.016590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.017248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.017532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.017818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.018567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=b84e078154c949168ec4bafbe86e7a15) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:21.018878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:21.020646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46de27b-25e7-4062-a4d1-ccf010425f8e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:21.025514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.027637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 217/434] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:20 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=b84e078154c949168ec4bafbe86e7a15&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:21.079445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64c3d-683a-40b3-b194-ceae81eea64a None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.080104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64c3d-683a-40b3-b194-ceae81eea64a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.080594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f64c3d-683a-40b3-b194-ceae81eea64a None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.082512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 218/435] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:21.084969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 218/436] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:21.089203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.089609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.089975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.106841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.116565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:21.118482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:21.180216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.217472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 219/437] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:21.232856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa7fc0a-14f0-4995-a6c1-4a7ce7e65f3b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.279975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.280602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.280877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.281146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.292268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:21.296988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:21.297857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:21.298659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 219/438] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:21.305740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.389862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.421691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.431919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a28c71-41c5-4442-bbd3-9089c3efcf96 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.476629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.477413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.477700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.478272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.478981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:21.479441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:21.480834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:21.491094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 220/439] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:21.496832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.546659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f189380-e1c0-4102-a928-b18504d3fab4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.548883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.588051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.588680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.588956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.589224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.601408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:21.606251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:21.607308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 220/440] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:21.609692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.626478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b14f6-3c67-48ef-a7eb-2870f821fcbc None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.666864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.667390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.667755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.668021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.708427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.725576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a96a48-a390-4844-b16a-7570333fdb10 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.748747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:21.750244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:21.760317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.760942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.761225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.761488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.771732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:21.776926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:21.777882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:21.778697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 221/441] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:21.779366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.794275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.856369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 221/442] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:40:21.857207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.881388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330932df-9eae-4279-93a7-b8c7eaf93e8d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:21.916571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:21.917221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:21.917435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:21.917725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:21.918360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:21.918659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:21.920049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:21.928644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 222/443] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:21.929445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:21.940000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:21.964878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8d47-4b09-4c42-9dfa-a63438049a86 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.001643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.002249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.003154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.003154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.003651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:22.003948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.005653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.015345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 222/444] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.020764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.020764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.038549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a93c-6fa5-4106-915a-c8d6258a5445 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.082106 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.082873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.083299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.083689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.084933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.086378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.088044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 223/445] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:21 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.088811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.125469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32abd80-2879-4c90-94cb-60be734c5a71 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.178950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.180096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.180096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.180096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.198951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.226664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec321bd7-074d-4872-874f-3441e84b87bb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.262561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.264040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.264652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.264928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.265199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.265325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.269526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.351632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.353336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.391891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 223/446] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:22.392752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.439175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.467726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 224/447] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:22.468884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.507510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237a738-fdfc-4fee-9522-ade256dd34e0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.509423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.544780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.545416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.545692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.545962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.547119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.548599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.550188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 224/448] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.550958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.577510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93942d4-677e-4083-a06c-22ea97e67504 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.612359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.612987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.613268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.613618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] PATH_INFO: `/v3/projects/8a93c797804e4fcf803d5beab9da8d14` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.615191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] RBAC: Authorizing `identity:get_project(project_id=8a93c797804e4fcf803d5beab9da8d14)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.616673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.618283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 225/449] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/projects/8a93c797804e4fcf803d5beab9da8d14 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.619043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.657778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc9450-63b7-48f7-835d-3f4f5b728252 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.666438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.693198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.693738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.694013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.694287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] PATH_INFO: `/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.695402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] RBAC: Authorizing `identity:get_project(project_id=aa9562368e9a4def85d52ce0d60bc9dc)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.696865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.698475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 225/450] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/projects/aa9562368e9a4def85d52ce0d60bc9dc => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.699223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.725452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6731b-8aaa-4b1d-b5ff-bdf860d69f76 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.739818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.759880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.760488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.760742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.761007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.761716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=97c92764f4f344c5a16b60e86473677d, scope.project.id=8a93c797804e4fcf803d5beab9da8d14) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:22.762015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.763420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.769724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 226/451] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=97c92764f4f344c5a16b60e86473677d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.783763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.808293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ad1e9-cf93-49fa-986e-5a9c729b8941 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.854330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.854997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.855279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.855591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] PATH_INFO: `/v3/groups/5db9e47d09514bd284fb229016310c84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.856849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] RBAC: Authorizing `identity:get_group(group_id=5db9e47d09514bd284fb229016310c84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.858394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.860089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 226/452] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/groups/5db9e47d09514bd284fb229016310c84 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.866178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.896023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922943b-c806-4a77-8081-e715d9ae0e5c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.907421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:22.944655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:22.944655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:22.944655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:22.944655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] PATH_INFO: `/v3/groups/85d9b65ee0394a028a80925a9a92c5ed` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:22.945889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] RBAC: Authorizing `identity:get_group(group_id=85d9b65ee0394a028a80925a9a92c5ed)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:22.947358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:22.949169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 227/453] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/groups/85d9b65ee0394a028a80925a9a92c5ed => generated 229 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:22.954819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:22.985195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd04c5f-c968-4fba-b67d-c5ec9fcc9479 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:22.994166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:23.029349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:23.029975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:23.030261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:23.030530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:23.031253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] RBAC: Adding query filter params (group.id=5db9e47d09514bd284fb229016310c84, role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=8a93c797804e4fcf803d5beab9da8d14) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:23.031598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:23.033033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79556d4c-4f3c-4c93-814c-5012673de766 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:23.043644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 227/454] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/role_assignments?group.id=5db9e47d09514bd284fb229016310c84&scope.project.id=8a93c797804e4fcf803d5beab9da8d14&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:23.077019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bcabf-1ef8-4edb-ad5e-32650047f26d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:23.118201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:23.118829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:23.119106 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:23.119379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:23.120170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] RBAC: Adding query filter params (group.id=85d9b65ee0394a028a80925a9a92c5ed, role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=aa9562368e9a4def85d52ce0d60bc9dc) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:23.120478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:23.121954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e039-9f25-4c1f-941b-13f94ba83e7b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:23.128829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 228/455] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Aug 24 04:40:22 2022] GET /identity/v3/role_assignments?group.id=85d9b65ee0394a028a80925a9a92c5ed&scope.project.id=aa9562368e9a4def85d52ce0d60bc9dc&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:25.685554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c1a0-2074-4ef9-86d6-21e8bfa18e7a None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:25.686417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c1a0-2074-4ef9-86d6-21e8bfa18e7a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:25.686835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812c1a0-2074-4ef9-86d6-21e8bfa18e7a None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:25.688398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 228/456] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:25.696022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:25.697340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:25.698031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:25.741230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:25.743689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:25.792678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:25.800157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075950a1-2e48-42b9-b4a3-57862a6e6aff None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:25.800434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075950a1-2e48-42b9-b4a3-57862a6e6aff None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:25.800906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075950a1-2e48-42b9-b4a3-57862a6e6aff None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:25.803458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 229/457] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:25.809326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307994-35db-4818-b57c-c2cf8d92dc01 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:25.809913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307994-35db-4818-b57c-c2cf8d92dc01 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:25.810376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3307994-35db-4818-b57c-c2cf8d92dc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:25.846639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f3307994-35db-4818-b57c-c2cf8d92dc01 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:25.847871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3307994-35db-4818-b57c-c2cf8d92dc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:25.851491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 229/458] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:25.948461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 230/459] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:26.179663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:26.281518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f87a-b342-4ed1-92f9-1157b0ee04e9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.282022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f87a-b342-4ed1-92f9-1157b0ee04e9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.282531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9f87a-b342-4ed1-92f9-1157b0ee04e9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.285214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 231/460] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:26.297958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b407-caad-4c3d-ae28-82b5c88aba1e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.298466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b407-caad-4c3d-ae28-82b5c88aba1e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.298953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b407-caad-4c3d-ae28-82b5c88aba1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.319358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aeae73-c514-4a9a-abce-3cf2e3f56312 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:26.343814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ef85b407-caad-4c3d-ae28-82b5c88aba1e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:26.345957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ef85b407-caad-4c3d-ae28-82b5c88aba1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:26.359675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:26.360589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.361018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.361426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.374254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:26.376251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-aa030477-90b3-4155-90d5-253870bba7a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:26.394807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:26.396497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:26.397537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:26.397537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:26.397537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:26.403927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 230/461] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:26.405569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39ffc-1e91-4216-bd3d-8335a79aa0c9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.406091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39ffc-1e91-4216-bd3d-8335a79aa0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.406515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c39ffc-1e91-4216-bd3d-8335a79aa0c9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.408116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 231/462] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:26.409730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39ffc-1e91-4216-bd3d-8335a79aa0c9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:26.446785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:26.469925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 232/463] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:26.470182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.470355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.470694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.499806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:26.501170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:26.570123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c39ffc-1e91-4216-bd3d-8335a79aa0c9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:26.575957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:26.618696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 233/464] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:26.618696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:26.628016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:26.629065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.630293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.630757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.631678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:26.632164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:26.633857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:26.665063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 232/465] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:26.693295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:26.832035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b7f51-d297-4fc5-8dad-a833e1255555 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:26.846462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:26.876371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc847611-4d4f-48c2-b1cc-635f754a9c65 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:26.892396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:26.893407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.893769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.894107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.909247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:26.912195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:26.924402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:26.925531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:26.926008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:26.927015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:26.927885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:26.929467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:26.931011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:26.932202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:26.933248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:26.933248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:26.933248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:26.938735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 234/466] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:26.938735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:26.958114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:26.968964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 233/467] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:26 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:26.970162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.090406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b5fbcd-e426-415d-9d8d-4f2cb1f4e601 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.126415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7641b9da-8405-4a6a-840b-6b1738ce5342 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.137330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.138431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.138887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.139414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.158166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.159682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.167834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.168465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.168744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.169019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.169679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:27.169981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.172028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:27.180924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:27.181883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:27.183196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:27.183196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:27.183196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:27.183196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 235/468] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:27.183196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.184847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:27.195909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 234/469] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:27.196811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.276722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:27.333103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd16930-278a-47e1-8e92-7199e323bb2f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.342336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13f7b7-d91b-4184-8605-c82ce568710c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.375004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.375647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.375934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.376207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.376865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:27.377165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.378575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.381568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.382119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.382396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.382676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.396705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 235/470] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:27.396705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.399683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.401986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-10363f54-5c88-412f-bc8f-2f62d015862d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:27.418865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:27.419885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:27.421773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:27.421773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:27.421773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:27.421773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 236/471] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:27.422100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1087-0c3b-42d2-aab1-cc5543a40968 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.422465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1087-0c3b-42d2-aab1-cc5543a40968 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.422808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e1087-0c3b-42d2-aab1-cc5543a40968 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.424622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 237/472] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:27.428888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e1087-0c3b-42d2-aab1-cc5543a40968 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.474600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:27.526258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698205bb-cee3-44d5-92ea-dc0363529446 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.547157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e1087-0c3b-42d2-aab1-cc5543a40968 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.564484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.565108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.565655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.565927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.566579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.566718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:27.568117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.590012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.590627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.590904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.591175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.591868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.600521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 236/473] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:27 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:27.600707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634ebaf-580e-46b4-ab46-46767136e0b5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.600796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.636001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 238/474] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:27 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:27.637608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.637943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.638225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.692784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:27.694043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:27.746517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aea84-4a2d-44fc-b004-d285488a8299 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.765358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:27.799594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.800231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.800511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.800796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.802530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:27.802530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.803545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:27.821823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 237/475] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:27.827958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:27.840401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 239/476] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:27.947002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16457b-cba2-47d3-b357-b030797eec6a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:27.984101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:27.984701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:27.984973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:27.985241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:27.985883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:27.987304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:28.013754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 238/477] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:27 2022] POST /identity/v3/users => generated 249 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:28.126477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:28.257401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d6a8c-cfc9-44e2-8393-b5452f5f83fd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:28.259226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:28.303412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:28.304063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:28.304338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:28.304606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:28.305270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:28.306651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:28.317037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.sql.core [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:40:28.317037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:40:28.317037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [parameters: {'id': '27c63c2ac5d14634a5d75d1d60511788', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:40:28.317037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81490) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application result.read() Aug 24 04:40:28.334700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:40:28.335650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application yield resource Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise self.value Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application session.commit() Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:40:28.336572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:40:28.337430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:40:28.338330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application result.read() Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:40:28.339140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [parameters: {'id': '27c63c2ac5d14634a5d75d1d60511788', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:28.339968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 04:40:28.340756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:28.341599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 240/478] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Aug 24 04:40:28 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:28.347532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:28.387146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:28.470009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ad6bd6-5ba2-4eff-90b9-c3e768e9fee1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:28.511620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:28.512319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:28.512602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:28.512873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:28.526417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-51d9f6b5-ccd7-4d1f-951f-19f6fc33d1a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:28.531770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:28.532642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:28.533438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 239/479] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:40:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:28.538849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:28.649711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eaee8-3190-4b8e-9184-0c8664089874 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:28.691233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:28.692485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:28.692760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:28.693026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:28.693694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:28.693992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:28.695366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befeafc0-acea-4fa3-9690-cba419a050d8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:28.704387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 241/480] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:29.391978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8509c-f594-4eda-954c-6eeb886bf8d6 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:29.392679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8509c-f594-4eda-954c-6eeb886bf8d6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:29.392679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8509c-f594-4eda-954c-6eeb886bf8d6 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:29.394100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 240/481] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:29.400025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001ec1-96b6-4a0d-826e-f182d6201ddb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:29.400553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001ec1-96b6-4a0d-826e-f182d6201ddb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:29.400553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b001ec1-96b6-4a0d-826e-f182d6201ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:29.425680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5b001ec1-96b6-4a0d-826e-f182d6201ddb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:29.427409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5b001ec1-96b6-4a0d-826e-f182d6201ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:29.456261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:29.534853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 242/482] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:29.972573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8509c-f594-4eda-954c-6eeb886bf8d6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.121916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:30.141217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8509c-f594-4eda-954c-6eeb886bf8d6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:30.191117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:30.192473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.192895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.193194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.195072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4123-875c-47e2-a900-86f11c49f562 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.195364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4123-875c-47e2-a900-86f11c49f562 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.195666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a4123-875c-47e2-a900-86f11c49f562 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.198985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 243/483] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:30.205076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63548-84ba-405f-b29b-878783fceb3c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.205379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63548-84ba-405f-b29b-878783fceb3c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.205629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb63548-84ba-405f-b29b-878783fceb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.206462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:30.211871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:30.212823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:30.213652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:30.215790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 241/484] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:30.221944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.242618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2bb63548-84ba-405f-b29b-878783fceb3c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:30.245832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2bb63548-84ba-405f-b29b-878783fceb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:30.359789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 244/485] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:30.360764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979379ad-a0ec-49be-b493-02f712b8c8c8 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.361058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979379ad-a0ec-49be-b493-02f712b8c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.361531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979379ad-a0ec-49be-b493-02f712b8c8c8 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.362796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 245/486] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:30.366116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73b1b4-b75f-4bf5-8767-eaad4de05a5b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:30.373670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762deaa8-23d6-428c-9868-5636268288bd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.374028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762deaa8-23d6-428c-9868-5636268288bd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.374337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762deaa8-23d6-428c-9868-5636268288bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.426231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-762deaa8-23d6-428c-9868-5636268288bd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:30.428068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-762deaa8-23d6-428c-9868-5636268288bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:30.429940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:30.430571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.430848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.431116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.431855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:30.432156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:30.433549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:30.444752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 242/487] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:30.451387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.469079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:30.569717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca941-b4a0-47a7-ace4-eddc0af838c9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:30.587454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 246/488] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:30.618856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:30.619509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.619791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.620063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.636811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:30.638261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:30.658016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:30.658916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:30.660206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:30.660206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:30.660206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:30.660206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 243/489] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:30.665473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762deaa8-23d6-428c-9868-5636268288bd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.700041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:30.814420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762deaa8-23d6-428c-9868-5636268288bd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:30.859857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.863037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:30.864782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:30.865119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:30.865387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:30.866036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:30.866331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:30.867728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:30.881284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 247/490] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:30.887021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:30.952254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:30.981518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:30.998558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa132354-debe-470d-8a8b-f7039d011580 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.009467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3b172-b788-4b31-ab7d-077fdf111b59 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.036883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.037512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.037790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.038063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.049085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.049249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:31.049710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.049985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.050255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ea6fb0e3-363a-47ae-b3ed-05fb24448978 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:31.054919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:31.056043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:31.056834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 244/491] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:31.057880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658205-823e-4f91-bb4e-194d2711d855 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.057880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658205-823e-4f91-bb4e-194d2711d855 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.058162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15658205-823e-4f91-bb4e-194d2711d855 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.059586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 245/492] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:31.059700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.061217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.064290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658205-823e-4f91-bb4e-194d2711d855 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:31.077925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:31.078899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:31.079830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:31.081016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 248/493] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:40:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:31.081869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.184523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15658205-823e-4f91-bb4e-194d2711d855 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.189305 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93318d3e-76df-4eb7-b7eb-17e1bbf7d216 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.215630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.226865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.227431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.227606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.227787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.228040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.228133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.228350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.228620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.228716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:31.228994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.230404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c7497-384a-4d92-ba09-0c57739b02fc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.236324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.239621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:31.244801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:31.245869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:31.246868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:31.247456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 249/494] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:31.247572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 246/495] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:31.247645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.247719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.247792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.247792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.267157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:31.268426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:31.355519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 250/496] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:31.355519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.393580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674febb-1419-4fde-ace0-e00787af2482 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.444562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.445971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.446406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.446882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.447927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:31.448470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.449965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.485721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5ba13-e281-44a9-8d61-2d774a02036d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.496179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 247/497] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:31.496179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.520361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.527048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.527717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.527983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.528248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.538874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.540393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.542727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5a1038dc-6cf1-4f86-b212-33b800f03a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:31.557535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:31.558663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:31.559691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:31.559691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:31.559691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:31.563411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 251/498] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:31.564700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd7ae-6425-4736-a6ee-2dda8dc8e4bd None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.564980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd7ae-6425-4736-a6ee-2dda8dc8e4bd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.565504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297dd7ae-6425-4736-a6ee-2dda8dc8e4bd None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.567633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 252/499] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:31.568296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd7ae-6425-4736-a6ee-2dda8dc8e4bd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.610857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4d2c1-d85f-4d7b-9a5e-bf1b99e26f33 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.646616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.647217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.647523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.647802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.648465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:31.648761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.650130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.658139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 248/500] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:31.658936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.675140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297dd7ae-6425-4736-a6ee-2dda8dc8e4bd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.711001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.711568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.711847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.712117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.759883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141e6bd-68f1-470a-977b-d71fd2a88e6e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:31.762131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.763677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:31.783662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.785662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.795761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:31.796372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.796647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.796917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.797629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:31.797934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:31.799316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03819cc6-e8df-4e69-aa5a-5bb4acea2c3a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:31.817900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 249/501] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:31.819009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:31.819294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:31.819591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:31.837492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:31.838683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:31.902441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 253/502] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:31.903289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.915594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 250/503] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:31.915594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:31.996194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.014611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.017925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936181b9-f242-4243-9e49-f49f1ef4ed25 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.022819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e704c-7505-4fda-af23-de348424b7d0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.058129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.058368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.058758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.058928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.059021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.059186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.059306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.059515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.070296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.071072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:32.071901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:32.075892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.076785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 254/504] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.080475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:32.095541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.096529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:32.099373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:32.099373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.099373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:32.102199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 251/505] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.103110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.206014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d7f23-e96e-4360-a047-d1c01d5a473e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.209953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d37e6d-12b3-4bef-a554-3da9301dfb2b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.241346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.241958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.242234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.242505 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.244393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.245013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.245297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.245571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.249576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.250965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.256890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.258349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:32.263179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.264298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 255/506] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.265593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.268375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.269056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:32.277616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.278702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:32.279591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:32.279591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.279591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:32.279591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 252/507] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.279813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.371502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218fd3e6-8cf1-4bd6-b4e1-e8104411f552 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.384932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113e94e-5b3b-4983-87df-b83bdd4cf38f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.406216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.406821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.407091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.407355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.408047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:32.408350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.409713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.417950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 256/508] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:32.418811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.418933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.419561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.419840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.420113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.420755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:32.421056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.422405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.437213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 253/509] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:32.438035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.495291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.507752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.536557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db129328-6b04-426b-84f5-b2b79ef4c7fc None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.551945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f75aab3-64da-4b8b-bb0c-f7d8ae9becea None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.570851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.571490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.571782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.572285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.582541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.584005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.585670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.586274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.586560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.586822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.587563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:32.587863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.589309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:32.598852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.599882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:32.600716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:32.600716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.600716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:32.600716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 257/510] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.600976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.608217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 254/511] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:32.609054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.702739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d57e33-8886-4a35-8fb0-fb6c1eb595bf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.710257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39183820-13f9-4e3f-a3a8-25d2870876d0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.719436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.727528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.737491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.738149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.738455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.738695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.739424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:32.739828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.741177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.745599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.746221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.746493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.746764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.753214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 258/512] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:32.755424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.760025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.761458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:32.778125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.779256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:32.780361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:32.780361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:32.780361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:32.780361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 255/513] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.780586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.862018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f02777-c109-4391-8d37-009cb5832332 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.893579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a7b97-b1ec-40b7-85e9-c71725684d97 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:32.897859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.898482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.898755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.899024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.906023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.907445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:32.918965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:32.919973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 259/514] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:32.920850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.932180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:32.932844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:32.933123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:32.933419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:32.934063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:32.934366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:32.935753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:32.948545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 256/515] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:32.949354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:32.962371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:32.976896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.029112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c822f0d-bab3-40c1-ad7c-42f6a7c68a61 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.050372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c25109-95a5-48a5-8b01-f2c041a32b8e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.063121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.063762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.064040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.064311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.092813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.093437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.093720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.093993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.100953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.102392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:33.114750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:33.115823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 257/516] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:33.116817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.137907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.139247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.173301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.206424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.218914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5fced9-0506-4a53-a045-050cfb5c3072 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.249597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 260/517] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:33.250886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.264706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.265344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.265622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.265893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.266538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:33.266839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.268268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.280165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 258/518] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:33.280974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.354539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81c3d28-8bbc-4661-be9a-7420db722740 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.387663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68325d5b-e137-40bd-819c-f343597d319f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.402263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.402883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.403151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.403420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.404191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:33.404490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.405918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.418237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.424316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.424917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.425192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.425463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.426691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.428160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.447105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 261/519] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:33.448076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.449482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 259/520] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:33 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:33.450299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.455809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.585039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c935c-2f6a-4104-83c0-8a3df7b1c159 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.599122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376d8b7c-7815-4d07-87c1-90c124b7c1b9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.627619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.628329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.628725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.629586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.630286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:33.630682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.632795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.638584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.639303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.639677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.640018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.652204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.653178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 262/521] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:33.653846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.654143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:33.670434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:33.671380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:33.672612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:33.672612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:33.672612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:33.672612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 260/522] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:33.672822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.722346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.741346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:33.786403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086a6dd-af41-41b9-bd90-d0f4c5e6218e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.819606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1f3d2-9701-4577-b889-8f0ac70bd618 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.836526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.837090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.837360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.837631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.845466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.846914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:33.858439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:33.864668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 263/523] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:33.865783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:33.866497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:33.866497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:33.866695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:33.866971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:33.944432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:33.946717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:33.982916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363dbeb6-8aa7-4a33-9b6a-0f87c7932028 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:33.998653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.006070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.024509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.025203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.025548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.025887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.026688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:34.027637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.028608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.034449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 264/524] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:34.035810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.078412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 261/525] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:34.079720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.170466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0735a-d919-4880-b3d1-dd9457484ae0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.224144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8b0ac2-4d11-415c-b24c-fb713ab7a821 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.224508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.225125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.225407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.225931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.227538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:34.227851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.229300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.249636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 265/526] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:34.250671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.259986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.260593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.260864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.261136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.261960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:34.262263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.263716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.286548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 262/527] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:34.287548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.296519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.303995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.369563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e719a8-760f-49c1-8848-79b74f27f366 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.391582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b39e-eabe-479c-af1b-c605e8624402 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.409158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.410663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.411272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.411741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.423535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.425293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.428301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.428933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.429211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.429475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.436479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.437907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:34.443623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:34.444819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:34.445811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:34.445811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:34.445811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:34.447652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 266/528] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:34.448650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:34.449891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:34.450860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:34.451890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:34.455621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 263/529] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:34.456574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.535967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.562467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e78d10-6ab1-4936-82b3-5fd17d2cbf9e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.572007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.584552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438d8b9-995b-4ff5-91ed-557bba71c688 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.599282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.599998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.600200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.600483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.601139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:34.601437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.602845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.615961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 264/530] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:34.617002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.629383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.630681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.631134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.631611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.708504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.710422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.739015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c06053c-a918-40c6-a1de-93043a117c0d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.782077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.782827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.783108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.783374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:34.784080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:34.784378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:34.787101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:34.788935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.817446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 265/531] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:34.818474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.821287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:34.843616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 267/532] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:34.844830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:34.949117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cae4f-e90c-48f4-9d6a-4dbf8c280ef9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.962253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acb07e-0d60-47cf-af54-10fa4e9e030f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:34.993937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:34.994935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:34.995426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:34.995944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.001561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.002170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.002446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.002713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.003435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=a773a16903bb41a9b871ddd3534e5873) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:35.003804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.005327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.005520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.007163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.015642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 268/533] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/role_assignments?user.id=a773a16903bb41a9b871ddd3534e5873&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:35.016839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:35.026324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:35.027261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:35.028177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:35.035614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 266/534] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:35.038673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.140691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:35.146716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:35.202116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504da7f6-b6cd-48e5-a9a7-a3a986eb56ff None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:35.243363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.244672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.245143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.245778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.246683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:35.247453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.249100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.261791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b12e7b-6679-4d5f-893a-83167cd9f239 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:35.267290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 267/535] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:35.275422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.301935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.302572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.302849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.303121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.314439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.316959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:35.339047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:35.340035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:35.340844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:35.340844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:35.340844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:35.340844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 269/536] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:35.349239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.406835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54adfc1-c430-45a8-98b5-96d8e6a2f192 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:35.424291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:35.450766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.452101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.452580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.453059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.454012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=35b6d6e1beae43fab3e5b1a32447540c) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:35.454514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.456243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a114dc-691c-43c2-b1f1-502e6a9bbec2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.464450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 268/537] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/role_assignments?user.id=35b6d6e1beae43fab3e5b1a32447540c&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:35.496695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479841-822e-4027-9de8-61035691ab89 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.496972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479841-822e-4027-9de8-61035691ab89 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.497165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479841-822e-4027-9de8-61035691ab89 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.499970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 269/538] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:40:35.505679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.505998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.506230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.531224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:35.532486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:35.597030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f7df2-ea57-4ab1-9e6e-a09bcdbc0363 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:35.609828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:35.663295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.664793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.665343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.665800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.666675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:35.667165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.667586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 270/539] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:35.669953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.687701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 270/540] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:35.694574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.842641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901e612-a7f1-4412-8abb-63b962c87344 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:35.860382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:35.912254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:35.912913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:35.913197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:35.913476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:35.920947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:35.922391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:35.938830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:35.939855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:35.941635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 271/541] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:35.952347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:35.952525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.071027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5992c2-ac24-4e2a-a94e-c8d72ad71fa9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.119186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.119776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.120057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.120330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.142141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:36.147201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:36.148237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:36.149082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 272/542] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:36.158200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.195598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf23657-395d-46d6-9f1d-d7c3b411c647 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.225440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:36.234121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.234841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.235125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.235397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.236178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:36.236484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:36.238625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:36.251328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 271/543] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:36.257451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.309328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:36.361921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cdd5d4-5819-44aa-a42a-25b146ba1eb9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.416123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0700b-3cf6-4dd4-9014-9070dce5a6b8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.428915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.429568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.429848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.430168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.430992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:36.431302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:36.432705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6899e57-1d9c-4359-9cb8-a2b15d6d516e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:36.444605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 273/544] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:36.451094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5b05-deef-4f24-918c-592044518a28 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.451094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5b05-deef-4f24-918c-592044518a28 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.451094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a5b05-deef-4f24-918c-592044518a28 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.455369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 274/545] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:36.459341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a5b05-deef-4f24-918c-592044518a28 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.472235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.473856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.474138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.474412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.475153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=8753ed696f8d4cffb71475a945778e80) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:36.475495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:36.477390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c56a1c-1c8d-4f79-9378-f95d72a94f5f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:36.485596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 272/546] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/role_assignments?user.id=8753ed696f8d4cffb71475a945778e80&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:36.491504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.491504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.491504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.510173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:36.511996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:36.606714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 273/547] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:36.674020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:36.699603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a5b05-deef-4f24-918c-592044518a28 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.749043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.749673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.749952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.750221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.762230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:36.763702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:36.779031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:36.779997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:36.781349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:36.781349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:36.781349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:36.781349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 275/548] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:36.788143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.820434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:36.919886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:36.921464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc94e90b-237b-49b8-89b0-6ca7a3adec7b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:36.960228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:36.960778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:36.961011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:36.961286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:36.961936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:36.962271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:36.963634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:36.976917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 274/549] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:36.983888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.041815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09019c-a355-44f9-8017-41335a0c678c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.079817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.080919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.081377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.082777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.094748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:37.095720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:37.102238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:37.103679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:37.104643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:37.107639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 276/550] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:37.121043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d55fb-8a23-41fd-aa76-0ece6814fde5 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.121621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.152069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.158153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.158959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.159399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.160527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.169109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.172373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:37.193221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:37.194415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:37.195703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:37.196245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 275/551] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:37.202874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.330778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346d67c-7898-4624-ac61-fc9db8876dbe None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.390185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.390794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.391075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.391346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.392039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:37.392339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.393705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.397534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd91c1-d2dd-4968-9e2a-a01814d7cfc0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.406864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 277/552] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:37.416924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.455032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.455694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.455967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.456234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.457758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:37.458064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.459930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842c161-1f54-437b-9fb8-613b0fb37082 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.470707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.480903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 276/553] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:37.482169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8383aa-3733-4f0b-8f0e-c042e96727a9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.482542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8383aa-3733-4f0b-8f0e-c042e96727a9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.482888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8383aa-3733-4f0b-8f0e-c042e96727a9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.493969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 277/554] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:37.493969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8383aa-3733-4f0b-8f0e-c042e96727a9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.534207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.578170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8954ad-4499-4116-8138-edf03749f90f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.615974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.616457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.616734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.617003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.632048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.633844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.638479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8383aa-3733-4f0b-8f0e-c042e96727a9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-02c0c1de-2614-4c12-abb3-8efcdba8f10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:37.650421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:37.651574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:37.652912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:37.652912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:37.652912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:37.652912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 278/555] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:37.654143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.654524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.655149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.676748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:37.678203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:37.685026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.685812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.686257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.687182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.771495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 279/556] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:37.771495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.790653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.800092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.803091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.823786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:37.919263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afe6ac-c0df-4637-b2f3-67593326b74f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:37.942929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 278/557] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:37.954801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:37.972206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:37.972854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.973142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.973424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.974195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:37.974609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:37.976147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf14ebb-567d-488f-a2ac-d40b26e8079a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:37.989959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 280/558] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:37.991246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ea59-2f65-47e7-81e0-cb76d61fe539 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:37.995948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ea59-2f65-47e7-81e0-cb76d61fe539 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:37.996266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17ea59-2f65-47e7-81e0-cb76d61fe539 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:37.997981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 281/559] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:37.998758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17ea59-2f65-47e7-81e0-cb76d61fe539 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.086431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.092164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df296493-1d20-4234-ad95-610dafffcbb3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.111272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17ea59-2f65-47e7-81e0-cb76d61fe539 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.119181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.136865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.138249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.138795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.139214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.149020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.149775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.150231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.150593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.152095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.154089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.158405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.160174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-553c2221-0445-4b31-a618-31bc16bce9da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:38.171190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.172344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:38.173431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:38.173431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:38.173431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:38.175147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 279/560] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.177509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.177990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.178390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:38.180133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.181302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:38.182425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:38.185264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 282/561] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:40:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.186172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.206778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:38.208271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:38.281321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 280/562] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:38.282170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.312757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b3c94-707a-442e-90dd-f8b6e5153384 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.360136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.361016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.361436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.362318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.363884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:38.364958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.367044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.369048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.390813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 283/563] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:38.390813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.397646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9baf2-432e-44b4-a428-c2404b1360fd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.430158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.436214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.437027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.437393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.437768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.457049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:38.462603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.463700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:38.464696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:38.466857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 281/564] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.467849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.528766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f822d1c-f4a4-4ad7-aebe-71c5b55dba5b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.571949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.572712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.573097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.573475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.574313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:38.574808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.576274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.587901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67a594-580b-41e2-99f6-9f0e676fe09e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.599976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 284/565] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:38.599976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.633149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.633785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.634063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.634337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.641204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.642655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.646606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:38.660315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.661400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:38.662484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:38.668583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 282/566] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.668583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.700448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.719227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1ccbf-d030-46fc-9e31-88b30e39a91b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.756495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.757347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.757795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.758214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.759073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:38.759547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.761100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.772754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 285/567] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:38.773981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.775496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e482857f-70d5-4512-89d4-39392cc2f360 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.815997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.816667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.816943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.817215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.833388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:38.838631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.839739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:38.840749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:38.844386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 283/568] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.845171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.888183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2a9e7-8652-4bf6-940b-ca96f378a64a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.904777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.922738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.923364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.923672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.923944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.934788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.936246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:38.943121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:38.948524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ca6e8-5473-408a-9978-693fc3f45bed None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:38.952718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:38.953802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:38.954875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:38.954875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:38.954875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:38.954875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 286/569] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:38.955145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:38.990454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:38.991071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:38.991351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:38.991661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:38.992348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:38.992761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:38.994219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c80469-1418-4f22-aef2-fc6e42d52f65 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.008093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 284/570] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.009121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17055ff-5e11-4dd1-9abc-a0e2eab0614c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.009405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17055ff-5e11-4dd1-9abc-a0e2eab0614c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.009677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17055ff-5e11-4dd1-9abc-a0e2eab0614c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.010870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 285/571] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:39.011589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17055ff-5e11-4dd1-9abc-a0e2eab0614c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.062462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4df2d8-8143-4e59-8f7a-2540b9d989a3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.098136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.098760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.099029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.099295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.109865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.111300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.117337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17055ff-5e11-4dd1-9abc-a0e2eab0614c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:39.126511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:39.127691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:39.128730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:39.128730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:39.128730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:39.130101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 287/572] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:39.131083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.137903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.153136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.153739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.154019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.154288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.154947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:39.155243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.156649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.165364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 286/573] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.166064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.185118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.236606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177176d-5b29-4b8c-bbd3-ca1fe79228e0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.270223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c75a47-bbc2-4f8d-a946-fdab3f86b67f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.271698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.272308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.272591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.272871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.273512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:39.273815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.275178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320148a-5bed-404a-93a1-e1334b33a6c2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.289210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 288/574] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.290404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.290692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.290959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.305709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.306345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.306599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.306873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.307624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=c3a2418aa8404c7995c1e8a84ae66627) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:39.307936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.308992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:39.309365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.310191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:39.314817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 287/575] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/role_assignments?user.id=c3a2418aa8404c7995c1e8a84ae66627&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.316015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.375631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.397710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 289/576] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:39.398702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.458578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f799687d-183d-4301-9820-f9e9947815d9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.463243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.507160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.507914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.508510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.508863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.510543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:39.510921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.512577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.529157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 288/577] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.530250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.548500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f176d6-da60-4a4d-89c9-e001be4ab330 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.588390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.589021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.589405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.589683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.602222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.603795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:39.620689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:39.621683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:39.623905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:39.623905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:39.623905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:39.623905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 290/578] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:39.623905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.638441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c8a32-4faf-4597-b319-de996382c63f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.647048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.675737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.676470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.676751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.677042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.684511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.686104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:39.698821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:39.700002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:39.700902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 289/579] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:39.701408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.733408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.747261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592943b2-3972-48ec-9bb3-7d070953126c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.784112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.785519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.785834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.786150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.794622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.796093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:39.807988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:39.813923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 291/580] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:39.815392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.826048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d0959-602c-4d9e-8018-32425cc40642 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.868041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.868650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.868926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.869192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.869828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:39.870125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:39.871517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:39.884821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 290/581] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:39.885648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:39.916950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:39.930882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d11c6-207d-469a-8c03-d714e3504417 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:39.966373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:39.967002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:39.967295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:39.967573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:39.978791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:39.984064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:39.985143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:39.986189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:39.990142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 292/582] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:39.990871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.001768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438db1bd-6d98-4377-a105-20a63e7d92c4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.007440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.041401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.042002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.042375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.042554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.043241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:40.043805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.045009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.058141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 291/583] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:40.058752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.105594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45268409-6115-4776-9829-35fb01c06fb7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.155750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.156359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.157052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.157330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.158064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:40.158365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.160216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.169416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.185692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 293/584] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:40.185692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.194800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ad6ca-9b56-446c-960a-3db9d7a54d11 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.231988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.232613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.232889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.233147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.240952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.242388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:40.255564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:40.256494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 292/585] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:40.257428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.264189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.303679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64c606-7a6b-497a-8ef5-8aaf6d7b89dd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.341300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.341908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.342185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.342456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.343122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:40.343420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.344791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.353233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 294/586] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:40.354316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.381649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7464b90d-b0bc-48e9-9852-c32c95695f06 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.430885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.432104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.432104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.432395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.449148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=640768a362f64590b7cc779353b02b6e, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.450703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.456119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.468253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b564b90-f15a-42e1-af97-bf3e3b1739df None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.469712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 293/587] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:40 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:40.470605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.520360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.529108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.530051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.530477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.530893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.547925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.549641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:40.573015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:40.574223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:40.575308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:40.575308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.575308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:40.577207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 295/588] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:40.578331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.618319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccbeda-e26f-4831-9ae9-472a89b2eb87 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.663441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.664087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.664359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.664627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.665354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:40.665655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.667243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.688358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 294/589] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:40.689216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.706016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3eef-c93f-4347-b37c-e698ae529950 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.758254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.759960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.760700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.761187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.762421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.776466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.778228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:40.794354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:40.795421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:40.796344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:40.796344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.796344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:40.798436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 296/590] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:40.799485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.817787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e65b2-7339-45f0-9921-225c435999a7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.841479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:40.858996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.859706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.859901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.860171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.860985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:40.861095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.862458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.879510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 295/591] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:40.879510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:40.923006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15400cde-4230-4357-a8c6-138793193e5f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.961350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:40.962186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:40.962577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:40.962981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:40.975434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:40.977052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:40.993014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:40.994704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:40.996929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:40.996929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:40.996929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:40.997327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611befa3-a900-444b-b106-9aea1ef81e42 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:40.997473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 297/592] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:40.997473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.010361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.033762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.035121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.035777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.036370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.037161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:41.037603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.039105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.057798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 296/593] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:41.058945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.093453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.108351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd37ae2-dbc0-45a4-abfd-29cd9ab19b10 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.143412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.145083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.145083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.145315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.152775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.154304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:41.167569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:41.168687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 298/594] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:41.169734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.177414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c67f78e-eda3-438f-a443-3e094bee827e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.216567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.217421 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.217840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.218250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.219055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:41.219538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.221054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.234576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 297/595] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:41.235681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.273593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.288453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7514-63b5-4880-b9b0-62d0f2f85418 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.327050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.327800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.328102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.328377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.338057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.339517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:41.352505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:41.353718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 299/596] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:41.354693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.366849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc7961-02a7-42b9-969f-7b4bf2f8e859 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.367949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.402501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.403115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.403398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.403703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.404406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:41.404714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.406146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552849cb-faf1-4f09-86aa-eadc2b1047b4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.419279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 298/597] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:41.420730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408277b0-5744-4dc1-a5fa-fc436f7be7ba None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.421038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408277b0-5744-4dc1-a5fa-fc436f7be7ba None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.421313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408277b0-5744-4dc1-a5fa-fc436f7be7ba None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.427512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 299/598] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:41.428541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408277b0-5744-4dc1-a5fa-fc436f7be7ba None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.489477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fed29f-d8af-40d6-a478-e94976bb43d6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.536665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.537389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.537733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.538066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.545481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.546309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.547593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.555890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408277b0-5744-4dc1-a5fa-fc436f7be7ba None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:41.559873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:41.560817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:41.561684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:41.566589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 300/599] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:41.567434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.595535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.596146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.596425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.596696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.597541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:41.597845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.599395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac511ab-7217-49ff-a1bc-4ae01d299e5e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.623110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 300/600] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:41.624467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.624752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.625025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.638578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.643841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:41.645618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:41.682206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a564c5-0f52-4741-bb59-e663558b0c7c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.720666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 301/601] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:41.721411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.730646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.731387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.731770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.732118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/a773a16903bb41a9b871ddd3534e5873/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.748006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=a773a16903bb41a9b871ddd3534e5873, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.749644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.765382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 301/602] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:41 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/a773a16903bb41a9b871ddd3534e5873/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:41.766947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:41.843107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:41.875193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a097cb-46bf-4d12-a2e8-766be084a7bb None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.956118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:41.956836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:41.957128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:41.957476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:41.958196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:41.958504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:41.960008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:41.972685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 302/603] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:41.981253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0199f1-9c9a-4733-841f-e86f5f3c3c63 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:41.985932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.002262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.026712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.027671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.028118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.028544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.040373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.042084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:42.064394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:42.066519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:42.067839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:42.067839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:42.067839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:42.069698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 302/604] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:42.070678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.106476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fa2e89-8ca1-49c2-86e3-35ca8a84f129 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.141818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.142546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.142923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.143342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/35b6d6e1beae43fab3e5b1a32447540c/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.157279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.162936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=35b6d6e1beae43fab3e5b1a32447540c, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.164769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.185862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 303/605] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:41 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/35b6d6e1beae43fab3e5b1a32447540c/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:40:42.191897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.195047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e0ff-081b-4aeb-a8f9-1b2631a44c1f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.237122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.238583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.239012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.239573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.256514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:42.263644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:42.264692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:42.265552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:42.267616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 303/606] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:42.278491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.331784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.411050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bff95-2798-429c-bf0b-2822e63c89e5 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.414986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b905b-f9b7-4e6b-9e8d-4dc89198567e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.456052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.456850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.457138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.458432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.459138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:42.459360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.459523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.460289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.460724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.460899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.461301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.462139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:42.462854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.464975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.475168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 304/607] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:42.476633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 304/608] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:42.487003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.488668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.553157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.607086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.616815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e74f-602e-40b7-9dab-979a60c20cf3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.638273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b36a006-f240-44e5-85ce-959b35f3ce54 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.660612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.661302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.661525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.661800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.671971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.673867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.678280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.679206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.679729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.680212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7ca17366-907f-4692-b961-3cc4d9580b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:42.688208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:42.689201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 305/609] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1c0ce-f22d-4964-9e1e-462529d2cdc1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.694482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1c0ce-f22d-4964-9e1e-462529d2cdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.695092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1c0ce-f22d-4964-9e1e-462529d2cdc1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.695092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 306/610] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:42.700738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173901-373c-476f-bc95-10675341127a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.701015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173901-373c-476f-bc95-10675341127a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.701285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1173901-373c-476f-bc95-10675341127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.702638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.704538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.720120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d1173901-373c-476f-bc95-10675341127a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:42.720975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:42.721941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:42.723543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:42.723543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:42.723543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:42.723714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d1173901-373c-476f-bc95-10675341127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:42.725446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 305/611] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:42.726528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.807974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 307/612] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:42.809909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1173901-373c-476f-bc95-10675341127a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.859659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d5afba-aa39-46cb-bd3a-034346d4572d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:42.872345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:42.919024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:42.919792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:42.920124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:42.920455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:42.921264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:42.921625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:42.923171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:42.943634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 306/613] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:42.946075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:42.988552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:43.028609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1173901-373c-476f-bc95-10675341127a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.068935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b5d7c-07e6-4704-9c0a-cf5afdf627de None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.107739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.108506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.108848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.109197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.109708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.109997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:43.110364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.110625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.110970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.111350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/8753ed696f8d4cffb71475a945778e80/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.112016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.124467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 308/614] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:43.125391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.131343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=8753ed696f8d4cffb71475a945778e80, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.132927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.155609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 307/615] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:42 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/8753ed696f8d4cffb71475a945778e80/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:43.156522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.198705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:43.322637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7865633-c3a6-4e7b-9a68-2a849ff85f83 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.375128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a495af1d-f8e6-48e5-98ed-a9c3ac02df54 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.384910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.385929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.387304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.387835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.402760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:43.410988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:43.411999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:43.412835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 309/616] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:43.425857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.426775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.427424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.430252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.430529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.430865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:43.445609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.447930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:43.468916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:43.469916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:43.470861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:43.478758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 308/617] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:43.484921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.576328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f332577-bbca-4aa5-84f3-1f50491e58f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.617345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.618347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.618849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.619322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.620214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:43.620719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.622781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.634111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 310/618] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:43.640352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.693611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:43.745956 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe4d4-db84-480b-b483-72fd88c15810 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.760788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:43.799357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.800671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.801110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.801644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.803528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:43.804013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.805760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.807108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32eaed-cb9d-4bd2-8a40-5f6ca6f1e1b8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:43.843830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:43.844491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:43.844733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:43.845011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:43.848702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 309/619] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:43.854292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.858325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:43.859818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:43.874548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:43.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:43.877031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:43.877031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:43.877031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:43.877031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 311/620] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:43.884499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:43.986200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cd83e-9f23-4cce-9f66-ce52e860e2cb None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.003671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77108ae-d661-4903-bb52-5dd12e9d9150 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.031849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.038747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.044200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.045183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.045610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.046126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.046936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:44.047388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.049079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.049286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.050524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.050994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.051292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.064494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 312/621] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:44.072621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.076318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.078744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:44.106427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:44.107440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:44.108370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:44.108370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:44.108370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:44.108966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 310/622] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:44.113895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.234971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ceb742-a762-40f1-9359-08d378f3a6ec None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.256936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec6c4e-662a-4dfa-9fad-b44c665c5a87 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.274522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.275527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.275978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.276469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.284399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.286648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.297391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.298006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.298287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.298562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.299215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:44.299616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9788d399-b987-4548-9bf9-85b0992cfd3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:44.301138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:44.302259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:44.303355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:44.303938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3514a069-33a6-4fe4-b904-7208115e7c13 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.305559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 313/623] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:44.306982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ed675-cada-4d0e-a934-2c39ccfb57c8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.307488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ed675-cada-4d0e-a934-2c39ccfb57c8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.307966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ed675-cada-4d0e-a934-2c39ccfb57c8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.309809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 314/624] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:44.312820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ed675-cada-4d0e-a934-2c39ccfb57c8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.320162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 311/625] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:44.321596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.321890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.322173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.341359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:44.342765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:44.355361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.392114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.423880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 312/626] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:44.425419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.435109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ed675-cada-4d0e-a934-2c39ccfb57c8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.477817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.478870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.479486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.480013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.480965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:44.481485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.483175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.505286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 315/627] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:44.511244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.544088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c499e21a-c98f-4eed-93e4-9d7479707fde None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.587555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.588283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.588564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.588837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.596313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.598223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8253da8b-bab6-45a5-a398-cf0193658bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:44.612353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:44.613314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:44.614190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:44.618147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 313/628] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:44.619598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc2be-6b6c-42d1-b74b-1d4e08da78b2 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.619884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc2be-6b6c-42d1-b74b-1d4e08da78b2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.620212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cc2be-6b6c-42d1-b74b-1d4e08da78b2 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.621891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.623050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 314/629] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:44.624085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc2be-6b6c-42d1-b74b-1d4e08da78b2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.630908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493171c1-f23d-4b0d-b027-4ed64db814ae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.662761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.671245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.672301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.672787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.673279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.739266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cc2be-6b6c-42d1-b74b-1d4e08da78b2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:44.751461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.753339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.777640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:44.778188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.778464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.778730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.779452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:44.779891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:44.781434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaad2c-2f26-48f3-b422-d33b395bc80e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:44.799169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 315/630] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:44.799169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:44.799169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:44.799169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:44.816443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:44.817657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:44.859823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:44.869251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 316/631] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 04:40:44.870077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.894512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 316/632] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:44.895753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:44.924250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.011562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a9c729-d2c4-4dff-b2f4-9da3f175fcff None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.022791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36739b-c37a-417d-9454-020bc8786e87 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.059277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.059986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.060273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.060540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.067613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.068611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.069114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.069584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/c3a2418aa8404c7995c1e8a84ae66627/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.074399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:45.079650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:45.080572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:45.081517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:45.086799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 317/633] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:45.087749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.092775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=c3a2418aa8404c7995c1e8a84ae66627, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.094456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.109756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 317/634] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:44 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/c3a2418aa8404c7995c1e8a84ae66627/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:40:45.111024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.179697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.219163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.232970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d0f12-2f5c-4135-99cd-3c03bf113141 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.249137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e34739c-1e71-4592-984b-29b07167fb59 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.273353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.273995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.274275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.274599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.287817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.290389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.304105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.305113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.305632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.306179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.306952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:45.307217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.308548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:45.312376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:45.313311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:45.315090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:45.315090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:45.315090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:45.315090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 318/635] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:45.315090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.320138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 318/636] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:45.326561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.440113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e6cc58-5038-4c04-919f-b14e4950d41b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.449002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.480523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.481385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.481774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.482144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.482495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43a66a-2b71-48d0-ad9c-ca852ab937d9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.498316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:45.504295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:45.505460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:45.506497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:45.508338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 319/637] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:45.509240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.539270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.540445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.541298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.541723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.542767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:45.543259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.546108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.550914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.567221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 319/638] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:45.568599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.636960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419084-f010-47e8-b5f3-c98fa79e0141 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.678053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.678679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.678960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.679065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ea99f-3705-4110-9191-a88449d312b0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.679243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.692823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.694279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a43118f1-a411-44c0-83ee-1a90271d9ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:45.709940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:45.710901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:45.712209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:45.712209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:45.712209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:45.712209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 320/639] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:45.712441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080bf4-b5c7-43ee-96a4-04e72d19bef5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.712724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080bf4-b5c7-43ee-96a4-04e72d19bef5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.712822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3080bf4-b5c7-43ee-96a4-04e72d19bef5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.714159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 321/640] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:45.714771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3080bf4-b5c7-43ee-96a4-04e72d19bef5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.724910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.725527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.725799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.726064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.726723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:45.727085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.728522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.737248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 320/641] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:45.738161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.740695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.802760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:45.842257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3080bf4-b5c7-43ee-96a4-04e72d19bef5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.850916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b2a99-456b-4bfd-9497-ee4c7d5a7c18 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:45.885005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.885710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.885988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.886266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.892675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:45.893284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.893606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.893918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.894925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:45.895218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.895905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:45.896614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858dd86-045a-4b6f-914a-0d14de582129 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.897341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:45.908763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:45.909786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:45.910681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:45.913935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 321/642] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:45.914643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 322/643] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:45.915278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:45.915384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:45.915585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:45.915851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:45.935430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:45.936630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:46.003099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.006596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 322/644] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:46.009273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.029659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2c6c1b-ce8e-42f5-85e5-5921199ae5cf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.074296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.080946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.082255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.082794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.083288 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.096177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.098549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:46.115336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:46.116337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:46.117429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:46.117429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:46.117429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:46.119712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 323/645] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:46.120791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.127716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ee969-3306-4a45-82f5-e1f4e413a93b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.163017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.163413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.163719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.163988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] PATH_INFO: `/v3/users/glance` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.171453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.172815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:46.185482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:46.186491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 04:40:46.187414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:46.191544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 323/646] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:46.192758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.245491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78332124-6e25-44ba-a54a-52200bb4972f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.278616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.287276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.288157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.288646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.289029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.289800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:46.290169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.291930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.306047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 324/647] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:46.307534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.323043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d98bc1-88ae-46eb-91e4-79e40a0979ef None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.335174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.365658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.366101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.366445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.366723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.367362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:46.367687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.369087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.387273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 324/648] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:46.387273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.429342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316093-77d0-4934-9a30-dad95719e780 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.466838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.467444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.467747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.468021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.468747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:46.469050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.470479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.488984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 325/649] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:46.489654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.505484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5736e3d-0e9f-4dd8-9376-aba609cc4f54 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.540621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.550605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.551241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.551545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.551819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.562392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:46.567937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:46.568920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:46.569775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 325/650] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:46.570579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.604468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68ea9e-13e6-497b-8592-46716a6ab90b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.608658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.640659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.641179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.641452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.641715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.642427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:46.642723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.645152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.651102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 326/651] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:46.657445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.694109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ca0f8-5e0c-4bb2-aa22-233081ff6bd4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.744076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.745464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.746167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.746593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.759431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.760934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:46.775906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:46.776921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:40:46.777833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:46.782086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 326/652] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:46.783155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:46.813800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4d463-5a5c-4b78-9353-193fed40fe57 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.830125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.854657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.855781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.856274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.856895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.896933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:46.912383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3a871-4d5e-4b2b-9305-cdb1a8f0c1dd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:46.958457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.961025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.961441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:46.962255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:46.962713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:46.963168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:46.964038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:46.964614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:46.966153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:46.976478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 327/653] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:46.977617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.118438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 327/654] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:47.118438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.133638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.151753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab0f1ab-4614-4e36-a3d8-b06a581b8c7e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.199218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.200498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.201338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.202046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.202967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:47.203464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.206532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.228961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 328/655] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Aug 24 04:40:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:47.230075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.241982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.246428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d133784-b3c9-4db9-b657-46080f974fdf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.288214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.289362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.289726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.290066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.301284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.302739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-547630bd-44e7-45e8-9940-10d35c6de63b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:47.320263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:47.321435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:47.322494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:47.322494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:47.322494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:47.322494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 328/656] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:47.322883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b04b-c949-483e-a655-07ee5767dfb1 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.323167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b04b-c949-483e-a655-07ee5767dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.323439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195b04b-c949-483e-a655-07ee5767dfb1 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.328744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 329/657] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:47.329592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195b04b-c949-483e-a655-07ee5767dfb1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.360417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbd8d-efbf-4bac-93db-6639456b7cb9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.398523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.399585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.400067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.400547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.401623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.412044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.413469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:47.428995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:47.429961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:47.436075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:47.436075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:47.436075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:47.436075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 329/658] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:47.436075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.455226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195b04b-c949-483e-a655-07ee5767dfb1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.494661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.495274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.495578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.495851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.505225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.561150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff8da3-988e-4db6-9ae4-8bafc8d42f97 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.593994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.595576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.606035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.606654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.606930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.607200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.607891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:47.608189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.610216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8a44d-e33e-48e9-86bd-e5b1003387e3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.622650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 330/659] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:47.624098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.624383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.624654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.643366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:47.645377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:47.671892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.719518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 330/660] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:47.719518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.723279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 331/661] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:47.724161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.789307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:47.844195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7df01-da4a-428a-a493-1588f5ae6470 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.855224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af3bbf-a6c1-4c5e-8790-91e7641a59e3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:47.883156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.884193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.884646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.885082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.893064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.895796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.898991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:47.899733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:47.900085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:47.900418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:47.901450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:47.901957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:47.903495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:47.911134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:47.912162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 04:40:47.913316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:47.915558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 332/662] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:47.916738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.924461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 331/663] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:47.926000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:47.973853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.053395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c4591c-a064-4ea5-83cf-c00b8dc78ea3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.065062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.065324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4b9e9-cd55-42ea-bfaf-76258122b44c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.093393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.094186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.094795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.095077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.102696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.103299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.103607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.103878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.104600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:48.104901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.106348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.110061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.111541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.126004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 332/664] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:48.126450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:48.127364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:48.128357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:48.128357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:48.128357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:48.129715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.132076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 333/665] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:48.132919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.225730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.243042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d5f26f-9cc0-447c-9e2a-4e652973ecf9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.249173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f8223a-d131-4524-91cb-73c15ab7b8f2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.280901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.281647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.281991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.282330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.289934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.290780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.291148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.291561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.294081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:48.298517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:48.299603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:48.300648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:48.304547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:48.305194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.305275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 334/666] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:48.305275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:48.317839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:48.318770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:48.319887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:48.320311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 333/667] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:48.320882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.333934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.415496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e841-bfd6-4201-bff1-ca399f224578 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.430179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92461a-fbe3-4125-9014-2bd9bf054481 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.454899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.455539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.456641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.456641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.468826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.469512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.469960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.470129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.470747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:48.471047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.472547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.489744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 334/668] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:48.494188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.494188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.537761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.539338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.564326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.605029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953a4e1d-64f1-4fda-acb4-8839772d52fd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.644687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.645404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.645693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.645968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.646623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:48.646928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.648626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.651816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 335/669] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:48.652492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.666118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 335/670] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:48.666118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.728304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.771308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86eebb-cfc6-4f5b-b6c4-906116c2406c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.771941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6c749-cb14-4e7e-ae8a-7aebb942be54 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.796824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.810485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.811382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.811693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.811961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.814024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.814625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.815941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.816166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.817364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:48.817543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.818949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.820515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.821949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.832140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 336/671] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:48.833042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:48.834950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:48.835807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 336/672] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:48.841616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:48.936276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0798273-6648-431c-a31f-707fe560b912 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.941677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d0b1d-61a3-4ca7-86a2-bdc9faa2eae3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:48.964363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:48.972379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.973053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.973332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.973606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.976111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:48.976738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:48.977018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:48.977289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:48.985215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.986666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:48.988995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:48.990414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:49.001825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:49.002945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:49.004089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:49.004089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:49.004089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3dd112e8-b158-4a39-ba64-ae67190118a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:49.004807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:49.005826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:49.006841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:49.006841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:49.006841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:49.006841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 337/673] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:49.007627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914a54-0d41-45d1-b0e8-dffd8dee7303 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.007740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 337/674] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:49.007823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914a54-0d41-45d1-b0e8-dffd8dee7303 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.007894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e914a54-0d41-45d1-b0e8-dffd8dee7303 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.008234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.009110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 338/675] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:49.009843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e914a54-0d41-45d1-b0e8-dffd8dee7303 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.045968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.116069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e914a54-0d41-45d1-b0e8-dffd8dee7303 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.116566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba0600-fa66-4fd8-b174-406cb4f9721d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.150664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.150879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.151263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.151359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.151570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.151665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.151842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.151947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.152519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.152609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=a773a16903bb41a9b871ddd3534e5873) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.152818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.152907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.154230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.154333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.160541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 338/676] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/role_assignments?user.id=a773a16903bb41a9b871ddd3534e5873&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.161322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.184984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 339/677] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.187320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.231551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.279812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.285686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66096d9-c0a1-47f3-947a-4e59a8d0016e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.311408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825bf021-18c3-4015-9f34-7b572d98770b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.328259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.329152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.329430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.329706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.330482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.331367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.333146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfef93-123b-4574-9e60-c101defeea07 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.346096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 339/678] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.348946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a901-f604-4acb-8296-245669753c32 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.349487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a901-f604-4acb-8296-245669753c32 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.349981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a901-f604-4acb-8296-245669753c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.357465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.358944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.359226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.359525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.360178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.360479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.361840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.371397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d159a901-f604-4acb-8296-245669753c32 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:49.372909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d159a901-f604-4acb-8296-245669753c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:49.375394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 340/679] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.376178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.464419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 340/680] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:49.464419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a901-f604-4acb-8296-245669753c32 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.500129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.511184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8c3b6-685a-4c22-8e9e-c6f250e089ce None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.562050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.562763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.563134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.563521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.564402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=35b6d6e1beae43fab3e5b1a32447540c) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.565069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.566803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.575661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 341/681] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/role_assignments?user.id=35b6d6e1beae43fab3e5b1a32447540c&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.577086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.586353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.618458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a901-f604-4acb-8296-245669753c32 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.691915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.692680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.692959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.693232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.705719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.708351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:49.725817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:49.726806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:49.727782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 341/682] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:49.733277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.763010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a3677-3d5a-4d03-91cb-3d54575e4648 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.809491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.810228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.810513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.810786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.824736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.826557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:49.839336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:49.840400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:49.841371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 342/683] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:49.841969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.862057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0528163-5b54-4198-93fd-decc1a358277 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:49.875894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.900981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:49.901666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:49.901907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:49.902178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:49.902916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:49.903217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:49.904732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:49.918732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 342/684] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:49.923640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:49.937523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:49.976277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647321df-6090-4f1c-ac15-9cf09626b254 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.017903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.018422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.018747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.019217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.033008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:50.040034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:50.040947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:50.041766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:50.046216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 343/685] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:50.046857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.062557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb837ec-891e-427e-a707-2239e051093f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.102553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.102913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.103194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.103463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.104285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:50.104587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.106062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.133893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 343/686] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:40:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:50.133893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.162684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.192376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdb116-4a15-4058-ab43-54f7ea23fdbf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.212310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.240864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.242003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.242426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.242997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.244246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=8753ed696f8d4cffb71475a945778e80) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:50.244951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.247012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.252574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344856a-6fba-4ed4-a9cc-1c989404c677 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.255161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 344/687] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/role_assignments?user.id=8753ed696f8d4cffb71475a945778e80&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:50.256179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.343789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.346096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.347932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.349135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.350270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:50.352910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.354496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.374201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 344/688] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:50.380576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.446670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e4342-7411-4caf-97f8-3bf3071ea811 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.485058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.485961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.486412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.486829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.504105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.535703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d43628f-e11f-49bb-9bf7-03e46e7f7ee0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.566891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.569394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.575341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.576280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.576932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.577208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.577474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.589717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.591181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:50.608603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:50.609595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:50.610486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:50.610486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:50.610486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:50.616700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 345/689] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:50.619797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.689849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 345/690] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:50.696537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.733684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01324a-711d-459c-b370-de577fa39eca None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.751856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.771128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.771796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.772071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.772349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.773044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:50.773290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.774657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.789101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 346/691] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:50.794445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.811239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64a9c2-9704-4ace-bd21-4ff07b117705 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.844094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:50.889801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.890465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.890740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.891006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.909687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba471e70-878e-4099-aa77-553a4678b77e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:50.914125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.915600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:50.942718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:50.943759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:50.944712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:50.944712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:50.944712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:50.944712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 346/692] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:50.946618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:50.947824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:50.948184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:50.948798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:50.949382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:50.957322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:50.958956 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:50.971169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:50.972758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:50.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 347/693] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:50.979091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.086988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6161f-e6fa-4d81-80a4-5674bac979ff None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.101436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.146858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.161150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a515498-5ccc-439b-bf8c-fcb8d1b5f395 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.161512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.162347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.162873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.163498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.164436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:51.164937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.166582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.186623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 348/694] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:51.193917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.233979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.234961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.235445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.235951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.236823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:51.237936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.239537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.252521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 347/695] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:51.260853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.399287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af8eed-259d-41dd-a1c8-fa4c70e76570 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.418745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d94be2-af46-4483-ad8c-86c5d7690a54 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.437043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.437682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.437955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.438224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.445950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.447390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-65ddd9c7-4bec-4552-aad8-b3855949a5c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:51.461914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:51.462847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:51.463749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 348/696] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:51.464721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4f07-4bf4-4a87-8d3b-65187aee0e99 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.464827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4f07-4bf4-4a87-8d3b-65187aee0e99 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.466389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca4f07-4bf4-4a87-8d3b-65187aee0e99 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.466389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 349/697] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:51.469205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.469818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.470088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.470357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.472518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca4f07-4bf4-4a87-8d3b-65187aee0e99 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.500132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.511696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.559675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.561532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.610439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca4f07-4bf4-4a87-8d3b-65187aee0e99 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.650858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.651846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.652359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.652831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.653787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:51.654291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.655961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4fc4f1-404e-413f-9490-6ecfd9ec81bd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.671027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 350/698] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:51.674009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.675043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.675544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.700558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:51.701078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 349/699] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:51.701938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:51.702367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.777358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.785910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 351/700] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:51.786912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:51.805807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:51.862039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa82b54-5490-463e-bfbe-7337c25efca4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.931070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:51.932228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.932654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.933322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.934654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=c3a2418aa8404c7995c1e8a84ae66627) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:51.935378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:51.937647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14de15-28ed-4ceb-87b8-8dba9373bab1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:51.945025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bdb65e-513e-45b2-88d3-a1fea0388cf1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:51.953662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 350/701] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:51 2022] GET /identity/v3/role_assignments?user.id=c3a2418aa8404c7995c1e8a84ae66627&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:51.956321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a32a6-6d60-4cb3-9c68-8f472bda2fa4 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.956753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a32a6-6d60-4cb3-9c68-8f472bda2fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.957155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a32a6-6d60-4cb3-9c68-8f472bda2fa4 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:51.959010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 351/702] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:51.965035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:51.965600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:51.966058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.002141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:52.005221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:52.036295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.036956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.037243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.037556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.080399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.082845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.106986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 352/703] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:52.113740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:52.114664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:52.116243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:52.116243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:52.116243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:52.116243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 352/704] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:52.120696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.125337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.192348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.197405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.252170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b22f8-5301-4e76-b67c-1c0169ce02bd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.263903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0f10d-6372-4656-a4b6-224acc449aae None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.307224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.308182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.308651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.309061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.322831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.324826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.328266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.329036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.329390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.329732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.332393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:52.332808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.334797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:52.347931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:52.349178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:52.350289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:52.350289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:52.350289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:52.351674 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 353/705] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:52.355543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 353/706] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:52.356688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.358879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.493328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ce13c-ae03-4b28-954a-e7085bf9a0d8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.505042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.508173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3de48-d6e5-4cbe-81d1-bbf52ad87a06 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.529040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.538491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.539130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.539412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.539702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.540346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:52.540673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.542033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.562327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 354/707] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:40:52.562678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.563311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.563635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.563907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.564516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.572604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.574053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:52.586750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:52.587692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:52.588598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 354/708] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:52.589073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.697678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd143d2-801a-4620-8509-e973df3af62c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.716570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7994e8-78e1-439b-8c26-20d8454daa91 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.734581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.735216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.735664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.736192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.736500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.738710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:52.749837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:52.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:52.756265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 355/709] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:52.757097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.767072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.767360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.767796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.768170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.768939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.770579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.795873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 355/710] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:40:52 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:52.797143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.797261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.835366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:52.892841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dcb60-7950-444c-a07d-15f40a4d3c6e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.934198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.934677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e026-c46d-4cb6-9799-020478ccb34b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:52.935018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.935362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.935736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.936684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:52.937078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.938936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435aeec-cbb3-4ff1-8f80-2d9dbe6624e8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.956278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 356/711] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:52.957902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2353f-549a-4c6c-8402-2a0a184112d6 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.958276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2353f-549a-4c6c-8402-2a0a184112d6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.958697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2353f-549a-4c6c-8402-2a0a184112d6 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.960063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 357/712] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:52.963640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2353f-549a-4c6c-8402-2a0a184112d6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:52.989383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:52.989980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:52.990257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:52.990524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:52.991155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:52.991456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:52.992838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ce064-5234-45d5-b1b8-ab5bd2301988 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:52.998327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 356/713] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:53.003766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.004086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.004346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.031765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:53.033553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:53.082518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:53.093675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2353f-549a-4c6c-8402-2a0a184112d6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:53.118373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 357/714] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:53.119584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:53.138858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:53.139502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.139801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.140071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.140892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:53.141197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:53.142642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:53.147215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:53.150685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 358/715] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:52 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:53.280044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12bbd7-9c6a-4991-880a-1583d60691e8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:53.330159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:53.331093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.331379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.331798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.332459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:53.332751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:53.334152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:53.343786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 358/716] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:40:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:53.410855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:53.575533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c496f816-70c7-4c33-bcdc-5ee7d5f59776 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:53.613148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:53.613776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.614044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.614312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] PATH_INFO: `/v3/services/network` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.614899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:53.616271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:53.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:53.626538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:53.628756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 359/717] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:53 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:53.633721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:53.736621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:53.754161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5672d78-b03a-4307-99db-19d79cd8d6d6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:53.791344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:53.791989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.792263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.792532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.793162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] RBAC: Adding query filter params (name=network) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:53.793460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:53.794815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc74b-a661-47da-a4f9-644d4357148f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:53.801541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 359/718] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:40:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:53.807048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:53.842322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:53.930905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a73283-3b41-4558-b061-9bd1ade6091a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:53.966129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:53.966732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:53.967052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:53.967322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:53.968037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] RBAC: Adding query filter params (type=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:53.968339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:53.969679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf4cb-be27-4e95-8758-c759bdb3cb1b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:53.976145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 360/719] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:40:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:54.718755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0094c3-6e9c-4c24-94e1-63b99245a11c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:54.719836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0094c3-6e9c-4c24-94e1-63b99245a11c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:54.720357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0094c3-6e9c-4c24-94e1-63b99245a11c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:54.722757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 360/720] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:54.741515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b45d-3f84-4b5f-b094-0805e5a0c694 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:54.742429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b45d-3f84-4b5f-b094-0805e5a0c694 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:54.742905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b45d-3f84-4b5f-b094-0805e5a0c694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:54.769454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ffc4b45d-3f84-4b5f-b094-0805e5a0c694 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:54.770660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ffc4b45d-3f84-4b5f-b094-0805e5a0c694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:54.866095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 361/721] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:55.193976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1a05-b00a-4bb6-8cfc-b918df3f3625 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.194365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1a05-b00a-4bb6-8cfc-b918df3f3625 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.194561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad1a05-b00a-4bb6-8cfc-b918df3f3625 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.196272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 361/722] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:55.201902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.202445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.202911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.217893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1a05-b00a-4bb6-8cfc-b918df3f3625 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:55.240594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:55.242193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:55.259108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:55.337033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad1a05-b00a-4bb6-8cfc-b918df3f3625 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:55.376352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:55.377257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.378132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.378400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.390675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:55.396477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:55.397422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:55.398536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 362/723] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:40:55.404351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 362/724] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:55.405359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:55.428913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:55.512026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7e32a-7921-4ec3-a583-8f7e1c6e82a4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:55.548628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:55.549872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.550148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.550412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.551070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:55.551366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:55.552765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec637c4f-1128-4139-b46d-45d68f77c3ab None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:55.561814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 363/725] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:55.569179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:55.661808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcfd4-c6d5-4c69-be0c-2b00447b6546 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.662140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcfd4-c6d5-4c69-be0c-2b00447b6546 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.662353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bcfd4-c6d5-4c69-be0c-2b00447b6546 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.664002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 364/726] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:55.672775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.673061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.673314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.701924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:55.703117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:55.730631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3961a-df40-42ea-870c-f73ae5ff2eea None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:55.801108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:55.801908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.802069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.802262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.815601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:55.817602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:55.826393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:55.837735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 365/727] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2a1885e7-de30-48a2-ab03-389a70cbc954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:55.838248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:55.839263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:55.840192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:55.840192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:55.840192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:55.840192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 363/728] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:55.841557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:55.845637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639b86-0651-4439-bdc2-022a24b08bff None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:55.846025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639b86-0651-4439-bdc2-022a24b08bff None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:55.847358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1639b86-0651-4439-bdc2-022a24b08bff None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:55.849028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 364/729] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:55.849831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639b86-0651-4439-bdc2-022a24b08bff None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:55.854995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:55.968779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869616-cb6d-454a-9cb1-382e5adbe7b4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:55.974311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1639b86-0651-4439-bdc2-022a24b08bff None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.012601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.013536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.013991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.014159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.014634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.014924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.015462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.015983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.016805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:56.017447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.019990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.027390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-37cb1ed5-ee18-41c0-9da9-e917c160c4a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:56.032520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:56.034192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:40:56.035241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:56.037188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 366/730] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:56.042271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.042271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.042271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.042623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 365/731] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:56.043783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.060506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:56.061776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:56.120267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.130672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.141455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 367/732] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:56.142583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.170171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f28c9-462e-4f5f-be83-6194a0887b89 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.209937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.210664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.210949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.211220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.211939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:56.212242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.213601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.225681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 366/733] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:56.226843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.260694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc591ab-4291-446d-9277-a829689b5d6f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.310214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.310941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.311163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.311437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.321953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.324225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:56.340875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:56.341938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:40:56.342880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:56.345995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d5b505-0868-4a82-acde-8b8e1186c18d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.347072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 368/734] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:56.348019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.370056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.387281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.388278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.388752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.389231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.400678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:40:56.406231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:56.407145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:40:56.407994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:56.410561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 367/735] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:56.411593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.419817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.490080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0393c7e-2ad9-4261-ae70-4c3cc6d3ea18 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.528505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edaefb-55ff-4a36-92f9-2df884eda5ba None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.528740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.529246 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.529521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.529799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.541288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.542761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:56.557778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:56.558851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:56.559796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:56.559796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:56.559796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:56.559796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 369/736] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:56.560450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.566614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.567157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.567436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.567737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.568467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:56.568760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.570223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.587585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 368/737] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:56.588205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.627824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.663008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e73bdbe-2aa0-4961-b585-cf723ba8e4ec None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.666452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.688369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e77688-91d0-4703-806e-1cc10b563f8b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.700726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.701336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.701614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.701888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.702543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:56.702846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.704232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0b7d6-cbc9-4dcc-bc27-b405a7ce61f1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.712959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 370/738] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:56.714328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b19f-8315-4fcd-83e0-f757745c03f0 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.714614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b19f-8315-4fcd-83e0-f757745c03f0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.714894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699b19f-8315-4fcd-83e0-f757745c03f0 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.716274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 371/739] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:56.720290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699b19f-8315-4fcd-83e0-f757745c03f0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.726113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.726719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.727004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.727276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.727960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.729326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.746048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 369/740] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:40:56 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:56.746864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.848991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699b19f-8315-4fcd-83e0-f757745c03f0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.871364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:56.875742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c6765-7704-4598-bbc2-0517542b2452 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:56.893720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.894411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.894642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.894870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.895546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:56.895850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:56.897234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:56.909474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 372/741] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:56.910314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:56.922188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:56.923027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:56.923464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:56.924927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:56.939376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.000102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.001547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.024525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9116d4-8ca4-45ba-a47a-09ac7f29470d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.062982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.063673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.063941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.064195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.076171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.077612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-226705f6-b88d-443d-b6ee-235f66074aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:57.092260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:57.093282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:57.094176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:57.094176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:57.094176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:57.094176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 373/742] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:57.094682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.094839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.095113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.114421 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:57.115609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:57.117054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.128159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 370/743] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:56 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 04:40:57.129102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.195495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 374/744] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 04:40:57.195495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.197077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.259592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54164f8-a853-4aa7-95dc-ad5f90232d63 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.297758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.298535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.298915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.299891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.308048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.309653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.318617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb33de-fbfe-42d4-b86b-9e50d0b66a90 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:57.322227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:57.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:40:57.324332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:57.324859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 371/745] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:57.326198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.358045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.358811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.359250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.359626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.360341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:57.360712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.363018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.379672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 375/746] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:57.381078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.401094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.452169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8b08d-65cc-4bea-948e-51810dd94384 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.454043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.496467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.497104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.497385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.497660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.497942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357559b-d4cd-48e3-922b-1b38d919d9a0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.509450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.510851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:57.531119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:57.532226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:57.533102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:57.533102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:57.533102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:57.534867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 372/747] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:57.535825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.544820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.545448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.545732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.546010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.546748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:57.547074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.548546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.568879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 376/748] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:57.569703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.656946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd718d5-ee79-4428-ac9d-fac499e3e153 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.667667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.691364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af8257-e45c-4875-b9b4-b95854920238 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.697926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.698563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.698843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.699113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.708321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.709750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.716345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:40:57.721393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:57.722342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 373/749] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:57.723312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.736041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.737525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.737879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.738375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.739009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.740398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.759713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 377/750] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:40:57 2022] POST /identity/v3/services => generated 240 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:40:57.759713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.839291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb34206-22af-442f-a160-19180eac3e4a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.893722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.894545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.894826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.895265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:57.896388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:57.896388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:57.898332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:57.906679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d5375-05d9-4e9f-a837-592e235c3491 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:57.915964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 374/751] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:57.917195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:57.948657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:57.949675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:57.950157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:57.950332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:57.950820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.010938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.043395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.045339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.048040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5059a59-4a36-4b3e-9589-a74a471a7596 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.087684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.088742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.089413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.090699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.091685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:58.092200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.093869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.118011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 375/752] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:58.119828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.175677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 378/753] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:40:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:40:58.176954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.233202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.257004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353539d6-1447-4fa5-bb0a-bc858f6abfa4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.287431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.304048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.304843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.305252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.305646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.312753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e612-11dc-43c3-9351-240285cbe782 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.313168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.315741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:58.327969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:58.328916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:58.329839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 376/754] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:58.330427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.361347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.362693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.363166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.363638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.375595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.378653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:58.395644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:58.397011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:58.399109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:58.399109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:58.399109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:58.399109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 379/755] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:58.399109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.441904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a5dd5-c658-499a-bac0-e6e8a6701b5c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.488324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.489178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.489603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.490018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.501728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.504268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.507720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.518577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc97129-a48d-479c-aab0-b8182b4db21e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:40:58.520803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:58.521962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:40:58.522940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:40:58.522940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:40:58.522940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:58.526475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 377/756] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:58.527354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.560445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.561402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.561828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.562280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.563177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:58.563732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.566419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.568357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.582941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 380/757] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:58.584061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.642446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad2288-ce84-4f37-adf7-794eaa8c4e60 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.678203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.678817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.679098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.679429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.680098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:58.680400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.681760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.695780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 378/758] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:58.696534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.708438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9fc7-5054-4963-91a2-5270c35a5ad4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.761384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:58.819070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72426e29-b2fc-4d94-9015-9a7a3f72deb7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:58.857756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.858365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.858644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.858915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.859667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=c3a2418aa8404c7995c1e8a84ae66627) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:58.860184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.861402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.866382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:58.867000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.867281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.867584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.879679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 379/759] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/role_assignments?user.id=c3a2418aa8404c7995c1e8a84ae66627&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:58.879897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:58.879897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:58.880083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.880168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65bd643-a009-46b1-9527-4d8f11a80e11 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:58.892072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 381/760] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:58.893696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052cad-4287-4335-a581-1de827e69ab9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:58.894102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052cad-4287-4335-a581-1de827e69ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:58.894526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052cad-4287-4335-a581-1de827e69ab9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:58.896422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 382/761] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:40:58.897645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052cad-4287-4335-a581-1de827e69ab9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:58.962930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.017234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052cad-4287-4335-a581-1de827e69ab9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.029019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643deeec-3399-4b43-8337-fab529ecb8c4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.059666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.063089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.063918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.064627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.064972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.074801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.076343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.077764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.078567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.078980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.079259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.087916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.089347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-be6356ce-3109-4995-ac61-07c8e2f71656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:59.090334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:59.091216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:59.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:40:59.094287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 383/762] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:59.095683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.096735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.097221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:40:59.107136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:59.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:40:59.108971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:59.113248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 380/763] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:40:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:59.114148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.119542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:40:59.121003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:40:59.209546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 384/764] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:40:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:40:59.210560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.239212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fce13-ecee-4bb5-ae51-90be04d935f5 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.262413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.289143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.289752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.290031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.290298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.290989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:59.291289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.292743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.322280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 381/765] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:59.329002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.368563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3381a-8282-42f7-ae66-1d25504b38de None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.412507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.440605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.441226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.441501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.441769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.442461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:59.442760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.444205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.475420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 385/766] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:40:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:59.489394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.526956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bdb69-e6e2-4d02-96cf-f4545ba1b1ba None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.577039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.578536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.578824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.579096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.579864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=89178d161ef04543903f563ef4fc599a) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:40:59.580238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.581828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.590839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 382/767] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:40:59 2022] GET /identity/v3/role_assignments?user.id=89178d161ef04543903f563ef4fc599a&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:40:59.592660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.644966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb2750d-953e-41a7-9c25-3baf1bfe2c70 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.648811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.703163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.704181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.704465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.704740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.715103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=640768a362f64590b7cc779353b02b6e, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.716800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.745412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 386/768] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:40:59 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:40:59.844922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17ab67-425c-4674-b735-307775f1065c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:40:59.849547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:40:59.914705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:40:59.915363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.915677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.916005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.916706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:40:59.918092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-7a469aa7-d776-42a7-b592-aa240e3ef233 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:40:59.934177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:40:59.935212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:40:59.936098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 383/769] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Aug 24 04:40:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:40:59.942138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:40:59.992893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c300b-51a1-4cc5-b515-7d4ffbfbc76e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:40:59.993211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c300b-51a1-4cc5-b515-7d4ffbfbc76e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:40:59.993432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c300b-51a1-4cc5-b515-7d4ffbfbc76e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:40:59.994959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 384/770] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:00.010006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:00.010196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:00.010462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:00.040133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:00.041357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:00.161462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858590a-1eae-4e2a-960f-76bd115d4a57 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:00.194685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 385/771] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:00.233754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:00.234381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:00.234656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:00.234929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:00.235688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:00.235991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:00.237437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:00.248593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 387/772] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:40:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:00.256863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:00.386871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8a6c7-e1d0-4635-91f8-10868025e444 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:00.388616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:00.444190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:00.444812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:00.445092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:00.445367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:00.446146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:00.446451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:00.447973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:00.464946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 386/773] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:41:00 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:00.473893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:00.521949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:00.628775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff61f0b2-be35-4c66-b9fb-eb16431d6f77 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:00.666188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:00.700206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:00.701271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:00.701605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:00.701948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:00.704938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] RBAC: Adding query filter params (interface=public, service_id=373e9dce65784bb4951f34f1a8543484, region_id=RegionOne) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:00.706206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:00.707938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:00.731075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 388/774] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:00 2022] GET /identity/v3/endpoints?service_id=373e9dce65784bb4951f34f1a8543484&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:00.738105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:00.885391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c25d1-ab6d-4c0a-9a9a-30091b83fcb1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:00.904535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:00.925996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:00.926613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:00.926889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:00.927160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:00.927814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:00.929294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:00.932845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c0c6c-b71d-4911-8cfa-16f2ec9645e0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:00.938658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:00.940573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:00.941392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:00.945637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 387/775] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:00 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:00.946999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:00.978448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:01.048328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:01.050032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.050555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.051027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.051886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:01.053477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:01.069092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dbbfd-2d2d-4f21-bdd2-ec7388807ac9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:01.071074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 389/776] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:00 2022] GET /identity/v3/services => generated 772 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:01.110463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:01.111155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.111529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.112361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.113022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] RBAC: Adding query filter params (name=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:01.113323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:01.114715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:01.125267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 388/777] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:01.126612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:01.282314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6876bf-57b2-4660-b28d-a01716d9fb59 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:01.321521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:01.322403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.322589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.322825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.323517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] RBAC: Adding query filter params (type=network) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:01.323848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:01.325292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba93c58-5dd7-402c-82e7-87c33af1c28c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:01.332782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 390/778] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:01.340776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:01.445395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:01.456666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef16f3-c335-43fe-bbcb-4eef992cad56 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:01.497362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:01.497976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.498297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.498570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.499278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] RBAC: Adding query filter params (interface=public, service_id=f9604f3aa8fb4d60960cd0c62360281e, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:01.499612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:01.500972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:01.519086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 389/779] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:01 2022] GET /identity/v3/endpoints?service_id=f9604f3aa8fb4d60960cd0c62360281e&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:01.524126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b72c-e3aa-49ef-ad95-c7530c8be43b None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.524403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b72c-e3aa-49ef-ad95-c7530c8be43b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.524671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0448b72c-e3aa-49ef-ad95-c7530c8be43b None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.525067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:01.526253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 391/780] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:01.531549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15049f-747b-4bb4-9e4d-86ed766ee4ea None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.531830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15049f-747b-4bb4-9e4d-86ed766ee4ea None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.532103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd15049f-747b-4bb4-9e4d-86ed766ee4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.580861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-bd15049f-747b-4bb4-9e4d-86ed766ee4ea None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:01.582507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bd15049f-747b-4bb4-9e4d-86ed766ee4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:01.617201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:01.642127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014fa9ff-dc6d-49f2-a816-641b89920c68 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:01.679531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:01.680540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.681012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.681491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.682307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:01.683882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500e55d-f010-4cdc-a623-0e73a243e82b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:01.695600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 390/781] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:01 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:01.756878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 392/782] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:01.975447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac64-55db-4d95-ac26-256488a09abd None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.975869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac64-55db-4d95-ac26-256488a09abd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.976371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5365ac64-55db-4d95-ac26-256488a09abd None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:01.977904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 391/783] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:01.983441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f912f6-9f7e-4523-911c-5707202ce5bb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:01.983751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f912f6-9f7e-4523-911c-5707202ce5bb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:01.984023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f912f6-9f7e-4523-911c-5707202ce5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.012871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e3f912f6-9f7e-4523-911c-5707202ce5bb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:02.014035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e3f912f6-9f7e-4523-911c-5707202ce5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:02.113180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 393/784] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:02.115807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ac64-55db-4d95-ac26-256488a09abd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.149216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:02.150213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172092-a03a-452c-9900-2e90c5907e9b None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.150500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172092-a03a-452c-9900-2e90c5907e9b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.150776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db172092-a03a-452c-9900-2e90c5907e9b None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.152415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 394/785] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:02.161224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.161540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.161762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.199073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:02.200533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:02.309705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5365ac64-55db-4d95-ac26-256488a09abd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:02.345004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 395/786] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:02.393488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:02.394151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.394430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.394701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.413053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.413442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:02.418755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:02.419794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:02.420629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 392/787] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:02.426719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.436799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:02.610616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:02.642287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3873375f-0c84-4475-8941-115bf687ee88 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:02.672592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dcb55c-8dd0-4e4a-b0e6-e8aa068c82b6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:02.683897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:02.684901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.685389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.685852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.698575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:02.703706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:02.704820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:02.706682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:02.713859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 396/788] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:02.715095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.719268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:02.720199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.721610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.721896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.722621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:02.722924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:02.724361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:02.739533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 393/789] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:02.740829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.820718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:02.861793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de66438-1b49-4318-a94e-4f51b3364ae4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:02.879845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b8623-663e-4778-bdfd-7f3dbaf33904 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:02.904198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:02.905283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.905782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.906247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.920042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:02.920884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:02.921492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:02.921772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:02.922053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:02.922705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:02.923005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:02.925072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:02.928068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:02.928999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:41:02.929833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:02.938440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 394/790] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:02.938440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:02.938696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 397/791] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:02.940568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:02.941386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.077719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a8332-054b-4150-9559-8edf8aa5b239 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.078983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd81be-6dba-432d-baec-45745fd0225f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.119232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.126070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.126714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.127740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.128020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.129340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.130290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.130864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.131330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.140631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.142868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.143549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.145322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:03.159656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:03.160660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:03.161565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:03.161565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.161565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:03.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:03.165292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:03.166157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:03.166157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.166157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:03.166335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 395/792] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:03.166335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.172728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 398/793] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:03.174515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.240680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.293954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe8b9-0ca7-48af-bfd6-a09e61004bc9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.301804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c97af9-985f-4778-806f-a377b7e9944e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.334278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.335438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.335958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.336452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.337314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:03.337886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.339643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.343945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.344566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.344845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.345119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.346372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:03.346687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.348750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.356492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 396/794] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:03.357804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.365250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 399/795] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:03.366409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.427152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.504493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b4d52-2b89-4798-b507-cfcc5b1dc211 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.510083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ecae1-667c-467a-942f-9b4c5f2f7890 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.524934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.547606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.549292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.549938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.550431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.551338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:03.551864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.553137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.553687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.553793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.554042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.554316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.567971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.573313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.573821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 397/796] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:03.574914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:03.590828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:03.591920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:03.592820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:03.592820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:03.592820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:03.595592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 400/797] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:03.596804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.700373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4991328-f1f5-42a9-bc76-a4f9c02f011c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.703707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.712396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce3c2e-e2ca-4971-ab75-ed2e388253ea None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.739639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.740367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.740655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.741053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.748863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.750300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.753424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.754562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.754845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.755321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:03.762927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:03.764062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:41:03.765081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:03.765772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.765856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 398/798] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:03.765856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.769135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-55603e88-3739-445a-b581-5f64a239d766 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:03.782823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:03.789425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 401/799] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfe07-7045-4330-9d25-11ff8ec0fe5c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.790464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfe07-7045-4330-9d25-11ff8ec0fe5c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.791186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627bfe07-7045-4330-9d25-11ff8ec0fe5c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.791186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 402/800] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:03.791186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bfe07-7045-4330-9d25-11ff8ec0fe5c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.818279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:03.913234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627bfe07-7045-4330-9d25-11ff8ec0fe5c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:03.954820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:03.955437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:03.955959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:03.956378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:03.957146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:03.957445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:03.958897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:03.979011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 403/801] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:03.979803 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:03.997220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.008574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f724a1-7c96-4a5e-9eb7-8fde5a4d2fcc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.045039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.045645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.045935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.046187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.046846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:04.047156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.048527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d209c-5a87-4184-8f42-cf97c16a4ffd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.060926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 399/802] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:04.062173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1c19b-18fe-4843-9846-d20e3601c8aa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.062457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1c19b-18fe-4843-9846-d20e3601c8aa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.062730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af1c19b-18fe-4843-9846-d20e3601c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.083489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9af1c19b-18fe-4843-9846-d20e3601c8aa None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:04.084707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9af1c19b-18fe-4843-9846-d20e3601c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:04.101855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aed835-e690-46f7-9d0e-96cc0a7b5adf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.140164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.140777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.141045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.141339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.142068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:04.142367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.144611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.163871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 400/803] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:04.165492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370766-4d89-4000-842d-9eb6536a4926 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.165776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370766-4d89-4000-842d-9eb6536a4926 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.166045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370766-4d89-4000-842d-9eb6536a4926 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.167418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 401/804] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:04.170047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370766-4d89-4000-842d-9eb6536a4926 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.175363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 404/805] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:41:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:04.176586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.214315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.274347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.312506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb9598-21fa-4aa1-b3b2-977e024ed08f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.313762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370766-4d89-4000-842d-9eb6536a4926 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.354166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.354819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.355077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.355350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.361061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.362547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.362712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.363059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.366481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.367950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.375921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.377975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-a818c1bf-a458-46f2-b5da-fb7650fd7ee0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:04.382054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:04.383005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:04.383993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:04.387932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 405/806] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:04.389238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.389573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.389893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:04.393929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:04.394856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:04.395785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:04.395785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:04.395785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:04.395785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 402/807] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:04.396602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.417709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:04.418906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:04.485582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.499074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 406/808] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:04.499969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.513621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e166f753-9d33-4483-932d-6de59aaf2a7b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.552916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.553522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.553803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.554177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.570281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.617126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d2f6d7-2843-4550-9a8e-44b09034eb69 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.629659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.631113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.653032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.653639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.653927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.654178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.654891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:04.655188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.656625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.676306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 407/809] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:04.677125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.721897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.745577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 403/810] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:04.746338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.794065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009435b5-d475-4306-8a6c-aea40f032949 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.822939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.842506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.843146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.843403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.843690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.844339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:04.844638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.846210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.857927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 408/811] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:04.858890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.862112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4eb46-fc83-4859-bb77-83bddc4a6dae None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:04.898028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:04.898657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:04.898930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:04.899197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:04.899801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:04.901204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:04.910011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:04.910982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:04.911855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 404/812] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:04.913381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:04.954816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:04.968403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe0fe3-d42f-4788-b9a7-4f26a972455d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.002234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.002913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.003192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.003491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.010506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c4096-3ce3-4e3f-bd36-65931ea40bbd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.014029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.015492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:05.030363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.031349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:05.032314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:05.032314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:05.032314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:05.032314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 409/813] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.032314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.050056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.050676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.050948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.051221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.061918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.063355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.068378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:05.078616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.079644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:05.080634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:05.080634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:05.080634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:05.080634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 405/814] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.080956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.161102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342dd5e-4864-4e59-a46f-bed3fa7770de None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.198950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.200616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.201331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.201675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.202013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] PATH_INFO: `/v3/services/network` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.202605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.204008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.214863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acdb5c-ed13-4d86-a5f9-0289f9b9d577 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.215627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.216696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:05.217522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 410/815] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.218315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.253871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.254420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.254696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.254972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.262197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.264001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:05.276891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.277836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:05.278708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 406/816] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.279185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.331021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.340772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d066343-9694-4611-8d82-3bdd6bf552fa None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.379310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.380043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.380215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.380517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.381124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.381427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.382795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.387512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 411/817] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.392534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.392732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470251d-54f6-4f54-8ce1-1b6885aa1d09 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.428711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.429320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.429598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.429870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.430517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.430818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.432202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.445122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 407/818] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.445970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.463067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.510302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cfaa5-0a14-4897-8542-eb4fc8a2b6b5 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.546666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.547284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.547590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.548151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.549426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.549731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.551089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.563422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 412/819] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.564586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.575656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a5ce2-f2aa-48fe-993c-9ee47ab455f3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.584291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.612819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.613444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.613720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.613994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.614625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.614932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.616332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.621167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 408/820] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.621801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.672642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc487870-1a33-43b5-8743-341cdd98f4e7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.711531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.713123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.713738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.714011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.714290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.714983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.715287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.716762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.730862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 413/821] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.731735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.741299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa1b7b-75d2-4c41-b195-81368ca553b1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.790093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.790712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.790992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.791263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.791963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:05.792267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.793637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.804285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 409/822] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:05.804285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.822933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:05.848178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45c564-9e82-4b5c-a4e9-72e01662bdb6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.886758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.887390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.887692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.887961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.895054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.896517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:05.908041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.914449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.915498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:05.915946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33109a-8418-46fb-b034-98693bf69da7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:05.916020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 414/823] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.916020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.944892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:05.945518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:05.945834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:05.946057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:05.952954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:05.954386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:05.966470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:05.967616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 410/824] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:05.968507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:05.972502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.025900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9dfa6-f63c-40d1-a74f-52b18003bc64 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.073149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.073580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.073838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.074101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.074732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] RBAC: Adding query filter params (type=network) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:06.075030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.076445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.082282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 415/825] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:06.083037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.085845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.097170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776c51-5271-4b23-84c4-fff7b2297efc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.133547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.134208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.134480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.134750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/c3a2418aa8404c7995c1e8a84ae66627/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.136688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=c3a2418aa8404c7995c1e8a84ae66627, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.138145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.154595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 411/826] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:05 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/c3a2418aa8404c7995c1e8a84ae66627/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:41:06.155423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.217183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a02170-0cfe-45a5-879b-d50a91764689 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.230923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.264575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.265239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.265520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.265806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.266593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.268106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.281063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bf06e-7b61-4517-9a03-8dffa90b72de None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.293864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 416/827] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:06.294404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.352083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.353062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.353539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.354066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.355007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:06.355611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.357274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.373329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 412/828] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:06.374481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.381692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.444110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbfe379-dda0-40c1-981e-9d2dd14b54a6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.498739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.498739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.498739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.498739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.500579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:06.500579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.501352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.516656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 417/829] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:06.519172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c261c6f-34dc-4dbf-a03a-e2d6436b16ad None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.519780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.543935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.572074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.572681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.572956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.573222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.573914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.575306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.607584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 413/830] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:06 2022] POST /identity/v3/endpoints => generated 337 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:06.607584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:06.714348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fad8d7-a272-4b75-af8c-0f02487cd3ee None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.752243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:06.794101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.795250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.795715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.796334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/89178d161ef04543903f563ef4fc599a/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.805302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ae90e-80cc-4803-8e52-b865b0ddf99e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:06.818310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=89178d161ef04543903f563ef4fc599a, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.820636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21bc43-a2b7-4200-9671-359d080e2dd4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.841723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 418/831] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:06 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/89178d161ef04543903f563ef4fc599a/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:41:06.859312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:06.859878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:06.860152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:06.860417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:06.861673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:06.862111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:06.863800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440b4ec-03cd-40ac-bf9c-a572f55ed5f2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:06.870970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 414/832] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:06 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:08.211457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385337-0d60-4296-8978-f8ca994d4203 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.211990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385337-0d60-4296-8978-f8ca994d4203 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.212100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14385337-0d60-4296-8978-f8ca994d4203 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.213633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 419/833] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:08.218854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868190-dce9-4b9e-a51c-e4cd97f06447 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.219247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868190-dce9-4b9e-a51c-e4cd97f06447 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.219413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72868190-dce9-4b9e-a51c-e4cd97f06447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.238624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-72868190-dce9-4b9e-a51c-e4cd97f06447 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:08.239829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-72868190-dce9-4b9e-a51c-e4cd97f06447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:08.271420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:08.309956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 415/834] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:08.441018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66375914-6fa6-408b-95a9-6e67992db8bf None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.441700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66375914-6fa6-408b-95a9-6e67992db8bf None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.442181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66375914-6fa6-408b-95a9-6e67992db8bf None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.444049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 420/835] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:08.449829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.450363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.456116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.475893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:08.477417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:08.561363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 416/836] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:08.589917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66375914-6fa6-408b-95a9-6e67992db8bf None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:08.710452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66375914-6fa6-408b-95a9-6e67992db8bf None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:08.749595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:08.750529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.750978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.751420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.764078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:08.769727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:08.770723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:08.771583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:08.774076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 421/837] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:08.780391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:08.844847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:08.882307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:08.905903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:08.911829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4de46-6834-4c9e-8e11-d348dc108935 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:08.952681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:08.953295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.953568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.953837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.954505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:08.955335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:08.956877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17fef9-3834-46f4-aa66-bd097dae2f51 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:08.966365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 417/838] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:08.967510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375457-f368-48e5-8cbf-b97f1442ded8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.967798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375457-f368-48e5-8cbf-b97f1442ded8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.968072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375457-f368-48e5-8cbf-b97f1442ded8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.971544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 418/839] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:08.971544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d8a6-63d2-4b50-bc5f-f1ad7454062d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:08.971544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d8a6-63d2-4b50-bc5f-f1ad7454062d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:08.972164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8d8a6-63d2-4b50-bc5f-f1ad7454062d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:08.974331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 419/840] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:08.974331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d8a6-63d2-4b50-bc5f-f1ad7454062d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:08.984086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d41dde4-de2c-4976-b95c-e01fab023461 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.022238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.022870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.023140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.023410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.024045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.025403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d9d73958-50de-4ec6-aafc-435f73f52c21 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:09.035621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:09.036722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:09.037575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.039618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 422/841] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:09.041252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991478f-2789-432d-ac9a-3c6369de3d7b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.041792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991478f-2789-432d-ac9a-3c6369de3d7b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.042070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991478f-2789-432d-ac9a-3c6369de3d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.059994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7991478f-2789-432d-ac9a-3c6369de3d7b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:09.061199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7991478f-2789-432d-ac9a-3c6369de3d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:09.092528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8d8a6-63d2-4b50-bc5f-f1ad7454062d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.128205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.129125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.129125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.129389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.133298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 423/842] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:09.134568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.134851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.135120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.142795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.144320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.154294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:09.155512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:09.160913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:09.161990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:09.162988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:09.162988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:09.162988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:09.162988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 420/843] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:09.163210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.174452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.180177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.247085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 424/844] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:09.247988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.293075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a78a8-f83c-4105-9075-f54aa29b7a0d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.332216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.333073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.333542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.333824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.334464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:09.334760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.336164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.346321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 421/845] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:09.347585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.409100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe26ce-6815-4f86-b10f-a8b5de90e845 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.438500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.449140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.449755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.450028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.453242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.453242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:09.453242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.453242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.472275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 425/846] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:09.472472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e07ef-da3c-4ab0-b117-ade905b861e8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.472570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.488299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.515014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.515655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.515936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.516213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.516852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:09.517161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.518732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.531513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 422/847] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:09.531513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.617912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b2fa7-3c6c-4c2a-8c69-1c7ebde7f4e5 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.659566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.659961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335d661-35c2-4404-abdc-bc52721728d7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.660164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.660438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.660703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.661293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.663539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:09.673045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:09.674313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.675192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 426/848] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:09.676501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.715934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.716576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.716894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.717121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.726598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.728088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.732332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:09.743450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:09.744677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 423/849] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:09.745989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.776385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:09.815256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da0a4-9b66-45fa-ba25-286cefeca076 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.857732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.858372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.858652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.858926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.866441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84d11a-ba99-4507-b43b-acdd0e9670ca None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:09.870767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:09.876933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:09.878284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 427/850] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:09.879504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:09.910983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:09.911654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:09.911935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:09.912205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:09.912837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:09.913135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:09.914499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:09.919517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 424/851] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:09.925498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.000990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc878ee-184a-40a8-a047-6d628f9a5e50 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.021380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.060231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.070451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.071564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.072052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.072527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.073887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:10.074444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.077186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.091786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b954b-15de-4148-846a-bce4696a4bc9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.113017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 428/852] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:10.114375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.159601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.160576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.161050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.161545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.162593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:10.163156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.164789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.176642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 425/853] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:41:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:10.177929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.293727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7ce12-ee94-44b9-a85e-e6be9518d952 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.338580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1fa0db-8e95-4142-b05a-f85a654c6c09 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.342151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.343086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.343427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.343787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.344530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:10.344898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.346965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.359572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 429/854] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:10.359572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.388200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.406924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.408635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.409137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.409751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.442956 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.533636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac12da-0c63-40c0-8386-ee6a30bb98af None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.540666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.542466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.599095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.600035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.600411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.600765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.617784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.619774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:10.638010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:10.639046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:10.639971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:10.639971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:10.639971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:10.642503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 430/855] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:10.648113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.686765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 426/856] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:10.688035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.719091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.771528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccfa0d9-0fcd-43d8-a080-be2b8c478549 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.779937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:10.808806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cef51-7fd2-4d62-a022-68ee66c959fc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:10.813111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.813849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.814903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.815552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.816318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:10.816719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.818186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.833156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 431/857] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:10.838309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.852345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:10.853380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:10.853911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:10.854381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:10.866594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:10.868627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:10.886519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:10.887565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:10.888475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:10.888475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:10.888475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:10.895665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 427/858] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:10.897392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:10.965659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bfbc8-682d-4eb8-a1fe-08085424ddd4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.008795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.016650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.018081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.018591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.018912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.028335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.029875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.039604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c4775-4bf3-44a8-826e-58a28dc1d016 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:11.043711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:11.044666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:11.045603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:11.051107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 432/859] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:11.052270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.095082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.102852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.103846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.104305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.104739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.105569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:11.106037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.107645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.130182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 428/860] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:11.132472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.205527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b3fee0-563d-4241-b0e1-99b79f7d5063 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.250221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.250888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.251310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.252536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.253581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:11.253983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.255898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.272936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d94b07-2300-4c87-82cd-1e39f6c5bb31 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.279559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 433/861] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:11.285274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.322074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.323029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.323344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.323789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.335716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.337710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.342252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:11.360271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:11.361966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:11.363079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:11.367530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 429/862] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:11.369318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.403353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.423964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd16df9-3fa2-4e41-8edd-e0f9ce507cb2 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.476237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.476982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.477260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.477526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.507408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00732-03fd-436e-beaa-2e150bc3df7a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.544011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.544865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.545292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.545714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.546552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:11.547027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.549025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.560539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.562930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea68ad4-8135-4d9d-bff4-b3c7bca69a44 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.567961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 430/863] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:11.569611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.648599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.662500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:11.684177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 434/864] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:11.685452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8457b8-b183-4dea-8fc1-03551d9390ab None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.685736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8457b8-b183-4dea-8fc1-03551d9390ab None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.686007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8457b8-b183-4dea-8fc1-03551d9390ab None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.687513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 435/865] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:11.690177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8457b8-b183-4dea-8fc1-03551d9390ab None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.713489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce0bd-1a7b-4b27-a146-54215c1e62b7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.766068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.766684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.767000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.767285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.768051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=c3a2418aa8404c7995c1e8a84ae66627) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:11.768357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.769807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04272b-188d-4d94-b045-96810eb5c5fc None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.776428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 431/866] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/role_assignments?user.id=c3a2418aa8404c7995c1e8a84ae66627&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:11.777537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.777819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.778085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.813331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:11.815313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:11.844490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8457b8-b183-4dea-8fc1-03551d9390ab None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:11.890335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:11.890990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:11.891266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:11.891562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:11.904475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:11.906016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:11.924980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:11.926049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:11.926928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:11.926928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:11.926928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:11.926928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 436/867] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:11.931123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 432/868] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:11.932762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:11.983725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:12.065417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b41ca4-b102-4f65-a5ea-f565b238eed0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:12.104296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:12.105163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.105608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.106040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.106833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:12.107277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:12.108818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:12.122716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 437/869] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:12.132009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:12.207336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:12.259227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80578d07-5ba5-4460-b251-2d7848102fbb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:12.268134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:12.296875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:12.297719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.298029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.298849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.306565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:12.308036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:12.320957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:12.321917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:12.322845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 433/870] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:12.327965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:12.394023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:12.398107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae832db0-5a8a-4d21-988c-ef35f5d21c9b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:12.452010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418770d-f975-417c-aab8-fe6780169108 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:12.460450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:12.461115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.461352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.461620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.462289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:12.463794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720da947-ea84-4c1f-8523-5665eef87de3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:12.468628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:12.488992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 438/871] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:12 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:12.490428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e228-f1b9-44a5-a91b-f2fe6532f114 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.490835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e228-f1b9-44a5-a91b-f2fe6532f114 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.491189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5e228-f1b9-44a5-a91b-f2fe6532f114 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.495531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 439/872] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:12.502402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.502663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.503239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.527088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:12.528293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.528843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.529319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.529557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:12.530523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:12.530881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:12.531290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:12.533736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:12.561231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 434/873] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:12.562886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:12.647722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 440/874] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:12 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:12.703693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2366b-3e51-4d7c-956b-c5d1bd63d1b1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:12.745870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:12.747100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:12.747444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:12.747816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:12.748564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=89178d161ef04543903f563ef4fc599a) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:12.748922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:12.750457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb375b-9097-442a-9bb4-0f1812abff9e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:12.758631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 435/875] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:12 2022] GET /identity/v3/role_assignments?user.id=89178d161ef04543903f563ef4fc599a&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:12.952080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:13.062557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:13.079910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b103eb-6e33-46c0-a995-5dbc2505676e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:13.124754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:13.125385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:13.125659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:13.125924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:13.127199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:13.128698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e65a5-5282-43df-b35c-307a951bf1a8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:13.149252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 441/876] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:12 2022] POST /identity/v3/services => generated 269 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:14.012843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d7e-5f1f-4a36-a66d-ccff78773ca2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.013415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d7e-5f1f-4a36-a66d-ccff78773ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.013415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46806d7e-5f1f-4a36-a66d-ccff78773ca2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.014997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 436/877] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:14.021837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e73c-bc89-4475-88c7-fd4b8587cd3b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.022343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e73c-bc89-4475-88c7-fd4b8587cd3b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.022422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6e73c-bc89-4475-88c7-fd4b8587cd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.043647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b3d6e73c-bc89-4475-88c7-fd4b8587cd3b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:14.044930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b3d6e73c-bc89-4475-88c7-fd4b8587cd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:14.129978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 442/878] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:14.416862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806d7e-5f1f-4a36-a66d-ccff78773ca2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:14.459912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:14.542784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46806d7e-5f1f-4a36-a66d-ccff78773ca2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:14.577785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624356c8-80cc-4b07-bc5a-04d4796fffbf None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.578077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624356c8-80cc-4b07-bc5a-04d4796fffbf None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.578381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624356c8-80cc-4b07-bc5a-04d4796fffbf None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.581026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:14.581381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 443/879] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:14.581660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.581921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.582198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.582783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:14.584176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:14.586391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.586693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.586937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:14.593803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:14.597968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:14.600306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 437/880] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:14.602276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:14.611128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:14.612374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:14.696879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 444/881] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:14.746682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:14.753345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb262cd-766c-4322-a09c-29b377de5f62 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:14.791830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:14.792447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.792725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.792998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.793635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:14.793935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:14.795309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:14.801759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 438/882] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:14.811174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:14.815894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:14.934941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf875d0-7b1b-442d-aa83-a815d1f0428d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:14.981778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:14.982814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:14.983318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:14.983863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:14.985165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:14.986273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:14.988864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc560f-0552-432b-bf42-39429b0e94aa None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:14.998343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 445/883] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:15.020807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.078839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117160c4-4429-44dd-81ca-962ac88d11fc None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.080137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117160c4-4429-44dd-81ca-962ac88d11fc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.080137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117160c4-4429-44dd-81ca-962ac88d11fc None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.081851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 446/884] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:15.087898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e8e9-cb5c-4773-8945-641444955008 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.088235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e8e9-cb5c-4773-8945-641444955008 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.088463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0e8e9-cb5c-4773-8945-641444955008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.110310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5fe0e8e9-cb5c-4773-8945-641444955008 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:15.112596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5fe0e8e9-cb5c-4773-8945-641444955008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:15.149736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc45a0c3-764b-4a79-8119-52be01246716 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.196969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.201544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.201544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.201544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.201544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.201544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.203816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9bd8a4d1-3733-47ea-ab9b-cf40068ad03e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:15.210671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:15.211739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.212569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 439/885] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:15.213361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cb4da-364a-4e19-8ed5-d190329e1d4b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.213361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cb4da-364a-4e19-8ed5-d190329e1d4b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.214114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cb4da-364a-4e19-8ed5-d190329e1d4b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.215016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 440/886] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:15.218624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 447/887] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:15.220796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cb4da-364a-4e19-8ed5-d190329e1d4b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.223116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.223780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.224360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.248297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:15.249892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:15.251832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.327042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 448/888] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:15.350926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cb4da-364a-4e19-8ed5-d190329e1d4b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.390311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.391076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.391413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.391780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.392429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:15.392929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.394300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.399789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 441/889] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:15.405008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.509075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.515896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85be268-1107-40cb-80c8-ccd902939054 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.552580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.556376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.557244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.557816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.558295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.559349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:15.559924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.562317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.569371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 449/890] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:15.575146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.603192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.618206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711be05-a00e-44c1-a74f-dd166dcc72a3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.659433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.660165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.660447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.660721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.672781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:15.678329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:15.679296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.680501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 442/891] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:15.681208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.703114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8331d90-bbfe-49ec-9696-44ee3abdc694 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.743785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.744393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.744905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.745076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.746587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] RBAC: Adding query filter params (interface=public, service_id=314db02a22b144eaa1ae4d35c9103521, region_id=RegionOne) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:15.746587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.747404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.763865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 450/892] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/endpoints?service_id=314db02a22b144eaa1ae4d35c9103521&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:15.764882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.834991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbf2ba8-4999-4c48-aebf-ddd00d095008 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.855868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.897162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.897814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.898093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.898363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.898957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.900384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:15.910123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:15.911122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:15.912060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 443/893] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:15.912839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:15.927669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1eb0-8ad3-40ba-b9ff-8a33480439db None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:15.937905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:15.975943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:15.976559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:15.976855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:15.977129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:15.977792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:15.978088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:15.979441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:15.989787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 451/894] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:15.990563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.049483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa346b-473b-4716-95a8-3d644a90b084 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.090978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.091902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.092340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.092826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.093443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.095341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.104309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 444/895] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services => generated 1268 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:41:16.105606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.130038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c99144-f565-4258-828d-83fabbb359e0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.152264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.183275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.184124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.184513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.184857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.186378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:16.186777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.189520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.198500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 452/896] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:16.204924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.221185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.265056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e8544-c8b5-4d45-8f96-bd054b2693ff None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.312553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.313162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.313441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.314153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.337644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.339362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:16.356456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:16.357517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:16.358399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:16.358399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:16.358399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:16.358399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 445/897] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:16.364332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.380953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2e97c-3e82-4f26-988e-f31c12f0b984 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.426394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.427012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.427288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.427583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.428400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:16.428699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.430434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.439547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 453/898] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:16.444304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.497192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef12b02-cee3-40ed-a595-9502f35031da None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.512200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.530399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.540801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.541450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.541882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.542162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.542823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:16.543152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.544683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.568059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 446/899] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:16.570366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.593605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eea8b-1945-466c-815e-17f3aab2d3ee None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.633312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.634229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.634539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.634986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.635970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] RBAC: Adding query filter params (interface=public, service_id=f8b87711dd1f428cabda300c63a9346b, region_id=RegionOne) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:16.636312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.637832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.649941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 454/900] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/endpoints?service_id=f8b87711dd1f428cabda300c63a9346b&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:16.653778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.701850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e623815-5c90-4ecd-abdb-5096cbb7fc36 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.763277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.764029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.764309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.764584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.773587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.775075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:16.789377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:16.791264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:16.793615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:16.795310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 447/901] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:16.796280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:16.858764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.889677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e85f67-a953-47d0-9bb3-f6a97714e353 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.907331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:16.921993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0fcf9-7ca4-4500-ba0f-ea3e4da0a2d8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:16.959781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.961444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.961610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:16.962190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:16.962469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.962744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.963217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:16.963589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:16.964068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.964623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:16.965541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c749b-b799-4da2-bc5e-5078090e20f5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.966326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:16.969540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:16.987686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 455/902] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/services => generated 1268 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:41:16.992362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 448/903] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:16.994416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:17.049278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343017-ba64-4ee4-af8f-05f6a514c5f9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.049702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343017-ba64-4ee4-af8f-05f6a514c5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.050817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6343017-ba64-4ee4-af8f-05f6a514c5f9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.052867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 449/904] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:17.058453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.058762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.059165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.080054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:17.081330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:17.183683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 450/905] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:17.200273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28217e1-ffd7-4d3f-aff4-917cc074d6f7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:17.244273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:17.244897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.245173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.245445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.290968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:17.322607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:17.324104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:17.435694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 456/906] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:16 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:17.437277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:17.471909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:17.487756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:17.561210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:17.574887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b40cf1f-bbfd-4345-a292-d87a3f07b2db None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:17.606930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d54abb-681f-4cf6-bf64-f7a287e3939c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:17.625519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:17.627727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.628438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.628862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.645368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:17.646948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:17.653511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:17.654387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.654838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.655268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.656248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:17.658537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:17.665151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:17.666760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:17.668230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:17.668230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:17.668230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:17.672018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 451/907] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:17.673174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:17.679150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 457/908] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:17 2022] POST /identity/v3/services => generated 241 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:17.791841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:17.808129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09621939-5691-49d0-83d1-b6c950beb640 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:17.855669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:17.856287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:17.856566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:17.856838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:17.857482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:17.857784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:17.859152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:17.873289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 452/909] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:17.881892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:18.000788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65e442-f25e-4bf0-9b42-5bce6574bebd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:18.034542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:18.040829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:18.041600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:18.041937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:18.042143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:18.050590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:18.052084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:18.064682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:18.065667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:18.066574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 458/910] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:18.071941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:18.190745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca675a05-6b5d-4f72-85a7-36088c6c2702 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:18.230342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:18.231415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:18.231943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:18.232428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:18.233331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:18.233853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:18.236108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c7f62-8d3b-46ee-8f9f-92c8f8212b04 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:18.254667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 453/911] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:18.261942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:18.375849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8821e-2058-4a04-a646-6779ee591804 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:18.412386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:18.413046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:18.413331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:18.413604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:18.414331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] RBAC: Adding query filter params (role.id=13d9af42193040ef8329dd6fa05cbaf3, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=89178d161ef04543903f563ef4fc599a) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:18.414637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:18.416106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b5420-0784-4650-99ae-dbadc3fe5452 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:18.422448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 459/912] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:18 2022] GET /identity/v3/role_assignments?user.id=89178d161ef04543903f563ef4fc599a&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=13d9af42193040ef8329dd6fa05cbaf3 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:18.543756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9b7d-22c7-4f17-96e1-d8e5546476ca None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:18.544404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9b7d-22c7-4f17-96e1-d8e5546476ca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:18.544909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a9b7d-22c7-4f17-96e1-d8e5546476ca None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:18.550205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 454/913] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:18.556438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:18.556732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:18.557065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:18.585028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:18.586228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:18.643923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:18.663168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 460/914] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:18.951690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a9b7d-22c7-4f17-96e1-d8e5546476ca None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:18.957333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.070780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a9b7d-22c7-4f17-96e1-d8e5546476ca None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:19.109820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:19.111906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.112405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.112874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.113680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:19.115322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3c7b382b-4d01-41d6-889d-4c407025e3e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:19.125187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:19.126299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 04:41:19.127112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:19.129412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 455/915] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:19.135398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:19.224189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292ba23-8a90-4782-800a-700d931623ec None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.225408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292ba23-8a90-4782-800a-700d931623ec None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.226019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292ba23-8a90-4782-800a-700d931623ec None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.228167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 456/916] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:19.235953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.236410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.236889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.256447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155522f-b67b-4e72-b1e1-6554109407f7 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:19.257009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:19.258969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:19.304902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:19.314727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.314727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.314727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.315008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:19.316705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:19.318144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:19.335546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 461/917] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:19.340407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:19.348175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.355980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 457/918] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:19.412652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.481756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409f95b-7f26-4628-aaf4-2941b2352e05 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:19.523942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:19.524568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.524835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.525105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.525755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:19.526048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:19.527428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:19.534210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 462/919] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Aug 24 04:41:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:19.539798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:19.652009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:19.654023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558334f-7f93-4935-8634-b0b940f946e1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:19.692086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:19.693067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.693559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.694033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.694920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:19.696706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:19.727252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 458/920] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:19.783920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b0a65-fb50-4d26-b292-cd70b5520813 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:19.802152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.836565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:19.837545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.837980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.838398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.839144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:19.840773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-bdc2c067-f923-492a-97df-1e6c8e9ae87c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:19.851371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:19.852673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 04:41:19.853887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:19.856680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 463/921] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Aug 24 04:41:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:19.864462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:19.927955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:19.934731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42095-c0b4-432b-9972-9fb507769bd1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.935020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42095-c0b4-432b-9972-9fb507769bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.935291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be42095-c0b4-432b-9972-9fb507769bd1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.936679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 464/922] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:19.943853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:19.944202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:19.944483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:19.970380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:19.971994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:19.995280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7587e01b-dfc8-4cf4-858e-b5b7db6f67e7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.050369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.050910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.051183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.051453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.052212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:20.052515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.053877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.058648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 465/923] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:20.060260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 459/924] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:20.066188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.179910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae483d-9e55-4364-8038-4a5a18a19ed2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.182343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:20.220049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.220667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.220943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.221214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.221847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:20.222147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.223605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.229184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 466/925] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:20.234838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.348378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f0f083-499e-4403-b6b8-a1f4de241f5e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.367808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:20.388334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.389296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.389763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.390210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.391190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.392545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.393626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3db5f5-0e0b-4ef2-9fa8-48f84a59e97b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.418781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 460/926] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:20 2022] POST /identity/v3/endpoints => generated 347 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:41:20.425075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d88a8-26b9-4500-88ba-7d69e48f9e71 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.425075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d88a8-26b9-4500-88ba-7d69e48f9e71 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.425376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d88a8-26b9-4500-88ba-7d69e48f9e71 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.427050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 461/927] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:20.432771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.433110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.433334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.457733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:20.459197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:20.548900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f072eb-87e0-443b-b758-d90c16b0d7bd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.565458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 462/928] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:20.592265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.592913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.593190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.593460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.594044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.597166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:20.606932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:20.607995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:20.608827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 467/929] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:20.615026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.727407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723a9c19-0ca7-4e30-9003-8cd08ef22293 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.740202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:20.765916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.766743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.767158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.767439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.768570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:20.769001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.770493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.776422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 463/930] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:20.783155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.827728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:20.868935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.905534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebf09b9-8aca-4576-b640-62f022e1ca46 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:20.955901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:20.956530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:20.956805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:20.957071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:20.957707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:20.958004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:20.959374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:20.973589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 468/931] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:20.977655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:20.998975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ae65a-8bf5-490f-8100-b3bc07ab8c96 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.043379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.044059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.044335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.044601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.058722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:21.064350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:21.065467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:21.066319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:21.070747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 464/932] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:21.071768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.091374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.099655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ed79a-4678-4d07-8d8b-b27666f0697d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.106488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.144580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.145102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.145438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.145716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.146561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] RBAC: Adding query filter params (interface=public, service_id=f752214d1536450cb37b2215c317ef58, region_id=RegionOne) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:21.146863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.148640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.159502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 469/933] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:20 2022] GET /identity/v3/endpoints?service_id=f752214d1536450cb37b2215c317ef58&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:21.161411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.209286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db789b0-404a-499f-9eda-d3b8fd551a52 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.262742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.264348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.264774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.265207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.266283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:21.267187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.268972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.276591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43d9e1-0782-492a-b2b2-340184a95db0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.285847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 465/934] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:21.287327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.330792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.332155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.332689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.333597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.334738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.336335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.351679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 470/935] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:41:21.403282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.421855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009f2b1-d3af-407b-b6ae-02aa94c355d6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.460436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.461389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.461862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.462318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.475596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.477352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:21.494070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:21.495144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:21.496093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:21.496093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:21.496093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:21.498841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 466/936] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:21.502532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.540693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.631142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689975e7-811f-425d-b3e5-4af1454fac5f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.672031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.672602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.672911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.673184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.674032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:21.674341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.675756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.689177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 471/937] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:21.694649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.800162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21867ad6-793f-4110-9b17-612aebfae6e3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:21.840111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:21.841143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.841699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.842259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.851709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:21.853512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:21.863849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-75ee3d27-f322-4423-9a54-1237ca53fff8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:21.875195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:21.876892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:21.878769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 467/938] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:21.883115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:21.918240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064a4b-0633-4a13-a8c7-045a1efc3896 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.918723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064a4b-0633-4a13-a8c7-045a1efc3896 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.919272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff064a4b-0633-4a13-a8c7-045a1efc3896 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.922176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 468/939] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:21.929692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:21.930447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:21.930921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:21.951590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:21.953129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:21.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.016828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd85cfb-cdcb-4e37-8780-5176ced008e8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.043147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 469/940] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:22.056335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.056946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.057220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.057485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.058210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:22.058509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.059947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.083731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 472/941] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:41:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:22.085188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.188262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffba37-0bc0-4367-a62b-d420eee5a414 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.217238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.225335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.225961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.226235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.226502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.237632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.239062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:22.254977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:22.256084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:22.256986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:22.256986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:22.256986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.256986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 470/942] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:22.262062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.336380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.378092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19cec3-537c-4615-82ff-bf4d0e5095f1 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.422218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.423802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.424286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.424776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.425628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:22.426148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.427907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.441881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 473/943] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:22.454903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.463395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.500167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ecbfa8-7389-45cc-b590-5b1c8fb7e189 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.548331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.549323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.549650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.549962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.550785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.552336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.555702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING keystone.server.flask.common [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 04:41:22.579458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.sql.core [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:41:22.579458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:41:22.579458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [parameters: {'id': '3ca3598b8a184a0097ba0e15db83a7f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:41:22.579458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81491) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a3f8f212-a0ee-4cb6-87c4-055c7bdbdc89 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca3598b8a184a0097ba0e15db83a7f3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca3598b8a184a0097ba0e15db83a7f3. Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:41:22.597899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 04:41:22.598783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application yield resource Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise self.value Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application session.commit() Aug 24 04:41:22.599812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:41:22.600716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:41:22.601608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:41:22.602397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [parameters: {'id': '3ca3598b8a184a0097ba0e15db83a7f3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.604449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:22.606383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3ca3598b8a184a0097ba0e15db83a7f3. Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 471/944] 10.222.0.85 () {60 vars in 1140 bytes} [Wed Aug 24 04:41:22 2022] POST /identity/v3/projects => generated 262 bytes in 265 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889cc5-01db-4ec0-a7c7-48cb556167e9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.608945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889cc5-01db-4ec0-a7c7-48cb556167e9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.616519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7889cc5-01db-4ec0-a7c7-48cb556167e9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.616699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d21d68-2e53-4561-859d-3ff5706d8da1 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.617242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 472/945] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:22.617242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7889cc5-01db-4ec0-a7c7-48cb556167e9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.659171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.660341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.660855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.661331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.663500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.671373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.673886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-91dbc156-1f82-4832-ae07-830247a68d0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:22.687347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:22.688589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:22.690070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:22.692550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 474/946] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:22.693957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.694240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.694512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.715281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:22.716542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:22.747587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7889cc5-01db-4ec0-a7c7-48cb556167e9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.785997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:22.786634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:22.786917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:22.787193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:22.791613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.795052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:22.796690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:22.811135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:22.812171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 473/947] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:22.813995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.827541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 475/948] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:22.827541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:22.950513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:22.959911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68d0ad-193f-4dd2-b908-d82cf8a82977 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:22.961420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5eb1f-be39-426b-be17-4b7951b7450e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.001848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.002778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.003262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.003740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.004389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.004958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:23.005075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.005282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.005552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.005921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.006229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:23.006531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.007974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.008111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.024711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 474/949] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:23.035532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.035763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 476/950] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:23.114100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.187847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.228737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eff35d-11a8-4589-b1c6-9d2089aa758b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.275596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f1a50-bba8-414c-a482-0cd708617c3b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.281430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.282702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.283181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.283691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/89178d161ef04543903f563ef4fc599a/roles/13d9af42193040ef8329dd6fa05cbaf3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.287617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=89178d161ef04543903f563ef4fc599a, role_id=13d9af42193040ef8329dd6fa05cbaf3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.288266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.307501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 475/951] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:23 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/89178d161ef04543903f563ef4fc599a/roles/13d9af42193040ef8329dd6fa05cbaf3 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:41:23.332323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.333111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.333390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.333744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.334308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.336646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5eaab027-68ab-4e98-86d6-84f428e32313 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:23.347243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:23.348433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:23.349304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 477/952] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:23.357200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.379535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.384898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed485-95ac-4fb3-a1fd-2f88d0702d75 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.385223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed485-95ac-4fb3-a1fd-2f88d0702d75 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.385445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ed485-95ac-4fb3-a1fd-2f88d0702d75 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.388268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 478/953] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:23.393061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.393371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.393612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.414014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:23.415350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:23.494130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a42a2-5acb-41b3-8175-1b982acc058f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.515561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 479/954] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:23.541976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.542596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.542930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.543208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.543880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:23.544186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.545548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.551736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 476/955] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:23.557163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.617843 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.680747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f534a-6716-40d2-8b30-4d2aea1990a5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.717701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.718316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.718588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.718854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.719551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:23.719850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.721200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.726209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 480/956] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:23.802834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:23.901860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:23.925484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabd517-f0bb-4874-87a0-f4086af1f43e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:23.963793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:23.964419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:23.964693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:23.964961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:23.965539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:23.966884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:23.976260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:23.977511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:23.978551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 477/957] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:23.983232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:24.090964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f944c-6ffd-416b-8ce9-3caaa31a3a02 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:24.102602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:24.133338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:24.134092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.134482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.134853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.135599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:24.135996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:24.137438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:24.142901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 481/958] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:24.148233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:24.254863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d651e-7826-45fb-b1cb-2629340a7f1c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:24.292506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:24.293117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.293391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.293658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.294301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:24.294595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:24.296045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2892c5f-5c34-4877-b388-2704d38a2c15 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:24.303135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 478/959] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:24.308608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:24.433305 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e73db4-1004-45f9-bcdb-125d27dd4285 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:24.476459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:24.477082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:24.477364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:24.477647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:24.478331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:24.479712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc4baf-cfdf-41fc-9659-5d01d12a71e2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:24.507460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 482/960] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:24 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:25.247456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42135d-95f0-4262-b6c5-2b08ba9901d7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.248005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42135d-95f0-4262-b6c5-2b08ba9901d7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.248296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42135d-95f0-4262-b6c5-2b08ba9901d7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.250022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 479/961] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:25.256315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdab9-f66e-4274-99af-62569f85074f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.256778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdab9-f66e-4274-99af-62569f85074f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.257057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cfdab9-f66e-4274-99af-62569f85074f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.276538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-20cfdab9-f66e-4274-99af-62569f85074f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:25.277730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-20cfdab9-f66e-4274-99af-62569f85074f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:25.304178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:25.367591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 483/962] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:25.447204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e2db-ac04-4796-aa77-a1be6f1855ec None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.447599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e2db-ac04-4796-aa77-a1be6f1855ec None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.447783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350e2db-ac04-4796-aa77-a1be6f1855ec None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.449397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 480/963] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:25.455251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4010-d80a-40f6-a62a-0a846d6f9a70 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.455856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4010-d80a-40f6-a62a-0a846d6f9a70 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.456344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1c4010-d80a-40f6-a62a-0a846d6f9a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.476250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2d1c4010-d80a-40f6-a62a-0a846d6f9a70 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:25.477806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2d1c4010-d80a-40f6-a62a-0a846d6f9a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:25.559282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 484/964] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:25.662556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350e2db-ac04-4796-aa77-a1be6f1855ec None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:25.674889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:25.725207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53256542-7d42-4b2e-ae92-292e19e9fbed None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.725544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53256542-7d42-4b2e-ae92-292e19e9fbed None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.725821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53256542-7d42-4b2e-ae92-292e19e9fbed None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.727515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 485/965] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:25.736449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.736944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.737326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.757247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:25.758585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:25.785510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350e2db-ac04-4796-aa77-a1be6f1855ec None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:25.837059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:25.838093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:25.838587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:25.839079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:25.839971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:25.841688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:25.850367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 486/966] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:25.861636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.sql.core [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:41:25.861636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:41:25.861636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [parameters: {'user_id': 'e2a976544718439984bdacd1a4cbcbc8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:41:25.861636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81491) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 24 04:41:25.869586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:41:25.870501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application yield resource Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application next(self.gen) Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise self.value Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application session.commit() Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 04:41:25.871502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.session.flush() Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application compat.raise_( Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 04:41:25.872376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 04:41:25.873263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application conn.query(q) Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application result.read() Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 04:41:25.876978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e2a976544718439984bdacd1a4cbcbc8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:25.887963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 04:41:25.889344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:25.890918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 481/967] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Aug 24 04:41:25 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:25.892154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:25.892268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:25.915908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:25.975812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.026315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16416da5-6683-4286-a067-0825c1a2da12 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.036990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72edd7-c2d6-4d88-8deb-4260f349f76d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.074743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.075509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.075810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.076176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.078320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.079667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.080324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.080723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.086539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.088736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.093089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:26.098974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:26.100856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:26.102814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:26.104333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:26.106580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 04:41:26.117040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:26.118156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 487/968] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:26.118156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.118409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 482/969] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:26.118409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.199078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.227133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb16e8-6d0d-4315-bde0-8b9fde86b687 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.250215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406bd5b2-0d43-4609-960a-cce21c9c155c None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.269922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.271219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.271538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.271826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.272694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:26.273326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.274758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.287191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 488/970] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:26.287559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.288378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.299064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.299727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.300021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.300325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.301752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:26.302071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.303978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.346129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 483/971] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:26.356506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.440559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58972b0d-8239-454e-91b7-49eb0ec26f02 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.489407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.491063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.491627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.492106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.493089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.494954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5a404-f07a-4f32-b295-94da2dc53d95 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.502213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f81-f6a3-4dcc-89d4-c69e5be83b10 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.506924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.517684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 489/972] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:26 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:26.518995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd1a4-f658-4699-88de-92c751670fdc None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.519524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd1a4-f658-4699-88de-92c751670fdc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.519658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dd1a4-f658-4699-88de-92c751670fdc None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.521238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 490/973] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:26.527602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.528304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.528809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.552680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:26.553889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:26.570322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.570937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.571217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.571543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.590290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.591017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:26.609095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:26.610885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:26.612240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:26.612240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:26.612240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:26.614785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 484/974] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:26.622437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.660399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 491/975] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:26 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:26.674847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.755366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6325b-0a15-4fdf-9e56-def47a564886 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.793060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.793952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.794400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.794821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.795669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:26.796147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.798227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.815909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 485/976] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:26.821271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.932177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8147a267-72c1-46fc-b0b4-74b97021238c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:26.940298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:26.964463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:26.973086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:26.973727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:26.974005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:26.974281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:26.982756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:26.984251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:26.997537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:26.998673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:27.000007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 492/977] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:27.005621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.076339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.089796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19e307-ae6b-4e04-9c9a-ca230995fd1e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.129237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.129870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.130154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.130690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.131017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.132428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:27.142698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:27.143997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:27.144873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 486/978] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:27.153387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.167974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adb57-eb90-487e-8bb7-17db7a547626 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.210838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.211378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.211689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.211966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.212708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:27.213015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.214476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.236821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 493/979] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:27.242592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.283795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f576ca3-d741-4803-bd3e-c9c3bc3992c6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.301425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.323816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.324424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.324701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.325025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.325608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:27.325908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.327282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.337481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 487/980] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:27.342778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.378641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.393425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1870661b-27d9-4d29-9af5-000e396e54d9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.432948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.433569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.433840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.434113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.492480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c453437-93bd-4815-b92c-1934ea304165 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.528353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.530275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.538543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.539172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.539447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.539741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.540469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:27.540760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.542123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.548901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 488/981] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:27.554735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.598902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.678195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 494/982] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:27.680099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.690984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.714835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8b782-94b4-4348-b558-9129341f5dc3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.764294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.764634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.764905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.765172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.765959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] RBAC: Adding query filter params (interface=admin, service_id=f752214d1536450cb37b2215c317ef58, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:27.766863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.768722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.778972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 489/983] 10.222.0.85 () {56 vars in 1249 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/endpoints?service_id=f752214d1536450cb37b2215c317ef58&interface=admin®ion_id=RegionOne => generated 193 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:27.780136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.809799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350b42b-437e-4b8f-988b-1129a178fb72 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.856256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.856889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.857162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.857425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.869329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.870954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.879770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:27.891603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:27.892606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:27.899249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:27.899249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:27.899249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:27.899249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 495/984] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:27.899980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:27.921944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55cd37-7aef-453e-a582-1a7a24d15578 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:27.963189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:27.963839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:27.964124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:27.964394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:27.965014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:27.966393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:27.975667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 490/985] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/services => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:41:28.045169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d6b85-9322-4951-b4ca-5489ba487942 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:28.087727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:28.088351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.088613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.088882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.089551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:28.089851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:28.091276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:28.106482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 496/986] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:28.113298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:28.136102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.231830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e42877-b52e-4996-91c4-4382e18d1312 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:28.275347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:28.276129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.276417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.276698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.284706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:28.286171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:28.299127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:28.300270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:28.301266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 491/987] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:28.306153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:28.375058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.420176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894944-5c12-4987-ace3-720e8ae67bd3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:28.460383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:28.461287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.461586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.461845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.462541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:28.462844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:28.464311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22076b-0ed0-4bf2-8ecf-18e1fdce4690 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:28.482667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 497/988] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:28.484719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:28.553032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dedfe-bc1e-48fd-b714-b3f007eaab63 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.553228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dedfe-bc1e-48fd-b714-b3f007eaab63 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.553499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dedfe-bc1e-48fd-b714-b3f007eaab63 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.554836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 498/989] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:28.560797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.561082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.561361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.572091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:28.581109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:28.582311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:28.598752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f903e36-cc0b-457e-8e6d-c50fb57ace9f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:28.633535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:28.634047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:28.634327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:28.634598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:28.635327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] RBAC: Adding query filter params (role.id=13d9af42193040ef8329dd6fa05cbaf3, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=89178d161ef04543903f563ef4fc599a) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:28.635758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:28.637201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:28.643519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 492/990] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:28 2022] GET /identity/v3/role_assignments?user.id=89178d161ef04543903f563ef4fc599a&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=13d9af42193040ef8329dd6fa05cbaf3 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:28.659269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 499/991] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:28.934143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.040818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a3f9b-1ef6-4abe-a64e-9ec5f09dbfb2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.076193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.076825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.077098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.077366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] PATH_INFO: `/v3/services/compute` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.077956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.079334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:29.088181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:29.089171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:29.089998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 493/992] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:29.095929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.149888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.207046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767b64f-29a7-40e9-b323-f4e4a82999e4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.243262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.243904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.244189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.244457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.245080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:29.245379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.246749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.252764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 500/993] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:29.258203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.262628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.366636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe014a-3f12-4e3c-af5e-f0dd216ad2de None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.401084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.401700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.401965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.402237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.402964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:29.403226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.404548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.410109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 494/994] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:29.415783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.528543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d443a21-51a1-4195-a6a2-3011d0fe07c8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.544231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.567995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.568612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.568888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.569156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.569851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] RBAC: Adding query filter params (interface=public, service_id=f2c0c655a63a4b8e9012290efe9062f9, region_id=RegionOne) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:29.570153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.571555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a405eba-47a7-49d6-8019-afb9670cbb46 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.576925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 501/995] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:29 2022] GET /identity/v3/endpoints?service_id=f2c0c655a63a4b8e9012290efe9062f9&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:29.583130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:29.653011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:29.690346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5704899f-d4d7-4848-9e77-c922d611b3ce None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:29.724456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:29.725065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.725343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.725615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.726214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:29.727583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ff8af-2d11-41ca-a176-b82b7f9bdbb0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:29.734078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 495/996] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:29 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:41:29.957626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64238da-c13b-4dfb-8b32-e29478272258 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.958010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64238da-c13b-4dfb-8b32-e29478272258 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.958212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64238da-c13b-4dfb-8b32-e29478272258 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.959653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 502/997] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:29.964976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:29.965335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:29.965619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:29.984015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:29.986368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:30.071703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 496/998] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:30.351361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64238da-c13b-4dfb-8b32-e29478272258 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:30.490371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64238da-c13b-4dfb-8b32-e29478272258 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:30.531039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:30.532256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:30.532537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:30.532818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:30.533402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:30.534777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-532ca934-1b4f-4a2a-8e88-c9e30c500c95 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:30.554497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:30.555730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 04:41:30.556591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:30.559800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 503/999] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Aug 24 04:41:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:30.563868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:30.635112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:30.640308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0241-126d-47ab-b27c-a43f1c34eaab None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:30.640596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0241-126d-47ab-b27c-a43f1c34eaab None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:30.640893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0241-126d-47ab-b27c-a43f1c34eaab None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:30.642409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 504/1000] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:30.647376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:30.647697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:30.647969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:30.666035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:30.667233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:30.678522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbec8e-74ed-4789-ac67-bcf0ff78b52f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:30.705854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:30.718822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:30.719684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:30.719858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:30.720230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:30.720765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:30.721339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:30.722436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:30.728243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 497/1001] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:30.734054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:30.755690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 505/1002] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:30 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:30.848707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c12ce-7cf0-402f-9cd9-84a5b56201c0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:30.878879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:30.889553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:30.890101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:30.890379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:30.890652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:30.891912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:30.892213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:30.893569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:30.903099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 498/1003] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Aug 24 04:41:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:30.904357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:31.009025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60a70-a5d2-41b6-b88c-84e4ba146881 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:31.033312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:31.045429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:31.046428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.046862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.047739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.048717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:31.050080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:31.067871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 506/1004] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:30 2022] POST /identity/v3/endpoints => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:31.159862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c22be-e24a-4b6e-bf34-9b8dec64eea5 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:31.205913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:31.206553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.206829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.207096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] PATH_INFO: `/v3/services/image` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.207716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:31.209078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:31.218314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:31.219664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:31.220523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:31.223571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 499/1005] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Aug 24 04:41:31 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:31.225782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:31.262782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:31.341668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b821b3-9f4e-45b4-987b-009f15b7ed9c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:31.377877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:31.378555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.378909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.379204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.379738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:31.380859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:31.382233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da4dd6a-105c-415b-979d-661940029fd9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:31.387626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 507/1006] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:31.393439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:31.446736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:31.507154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3eb98-a08b-4cde-874c-2251152482ca None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:31.542990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:31.543629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.543912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.544183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.544825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] RBAC: Adding query filter params (type=image) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:31.545125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:31.546471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dee626-2907-4c9c-9dd2-28feac01bc28 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:31.555505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 500/1007] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:31.705704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f565caf-319c-460c-807e-3af339f6b8f2 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.706191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f565caf-319c-460c-807e-3af339f6b8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.706191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f565caf-319c-460c-807e-3af339f6b8f2 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.707667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 508/1008] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:31.712895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:31.713327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:31.713441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:31.733883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:31.735628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:31.808270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 501/1009] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:32.083537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f565caf-319c-460c-807e-3af339f6b8f2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.196296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:32.206496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f565caf-319c-460c-807e-3af339f6b8f2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:32.248264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:32.248918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.249197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.249539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.250134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:32.252295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:32.261984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:32.263040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 04:41:32.264339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:32.267858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 509/1010] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:32.269576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.328715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:32.391095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca7ff9-1107-4807-a0ff-8d0ff9903059 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:32.426492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:32.427102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.427438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.427754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.428380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:32.428681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:32.430093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:32.439943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 502/1011] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:32.441099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.551110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1067792-f786-4afb-a14f-0a786b8365ff None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:32.587090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:32.587726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.588002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.588273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.588900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:32.589199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:32.590614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8af3a-7bf8-44e0-b267-e901aff3ccd2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:32.595687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 510/1012] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Aug 24 04:41:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:32.601469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:32.706553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc56e0bc-ed47-4066-89e3-f2993869c85e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:32.715856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:32.742599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:32.743196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:32.743524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:32.743757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:32.744416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:32.745820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7eacb-1167-45ac-8423-f77ed02e131f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:32.771502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 503/1013] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:33.076228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a629-42ff-483f-9175-3520c5b24e9c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.076752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a629-42ff-483f-9175-3520c5b24e9c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.076752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5a629-42ff-483f-9175-3520c5b24e9c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.078116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 511/1014] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:33.084180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8daa9-585a-444b-a755-1b90882aa241 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.084468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8daa9-585a-444b-a755-1b90882aa241 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.084734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d8daa9-585a-444b-a755-1b90882aa241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.103154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a9d8daa9-585a-444b-a755-1b90882aa241 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:33.104375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a9d8daa9-585a-444b-a755-1b90882aa241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:33.182275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 504/1015] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:33.454529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5a629-42ff-483f-9175-3520c5b24e9c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:33.481531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:33.503406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565594be-a1ef-4ca4-a23c-2700d2876565 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.503758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565594be-a1ef-4ca4-a23c-2700d2876565 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.503992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565594be-a1ef-4ca4-a23c-2700d2876565 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.505636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 505/1016] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:33.510619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.510896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.511167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.531084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:33.533165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:33.572921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5a629-42ff-483f-9175-3520c5b24e9c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:33.607164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 506/1017] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:33.611915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:33.612655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.612943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.613224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.614360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:33.615814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:33.619508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 512/1018] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:33.623101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:33.645857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:33.733899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe9fbd-645f-4cd2-ac27-9a3187d7059f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:33.769174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:33.769781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:33.770062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:33.770335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:33.770969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:33.772424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec0390-de3f-4d19-872b-ab5f76557fa9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:33.815551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 507/1019] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:33 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:41:33.892650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:33.996060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:34.012279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147514aa-eb20-4a58-95ab-c6ba65287317 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:34.051778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:34.052446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:34.052751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:34.053091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:34.054293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:34.065940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b591b-25d2-41c0-81ad-4ec22e2c11ce None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:34.083100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 513/1020] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:41:33 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:34.815753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4444a-3623-4e54-add3-80332dc8cec2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:34.816276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4444a-3623-4e54-add3-80332dc8cec2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:34.816355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4444a-3623-4e54-add3-80332dc8cec2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:34.817697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 508/1021] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:34.823066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:34.823357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:34.823659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:34.842516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:34.843762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:34.919625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 514/1022] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:35.192776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4444a-3623-4e54-add3-80332dc8cec2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.268048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.303821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb4444a-3623-4e54-add3-80332dc8cec2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:35.338963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:35.339697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.339991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.340328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.354701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:35.361112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:35.362347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:35.364563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 509/1023] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:35.369957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.450974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.481467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f1292-2d7a-43d5-84fd-efa52f9cf59b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:35.523236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:35.523871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.524153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.524422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.525080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:35.525379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:35.526734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:35.541946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 515/1024] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:35.543201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.648757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ca059-5129-4885-862c-2436a9d5c642 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:35.680216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.686335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:35.686971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.687252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.688212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.699379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:35.700849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-bb23e5c0-5555-4b35-9fc1-90dcd4c7df43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:35.715543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:35.716526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:35.722803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:35.722803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:35.722803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:35.722803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 510/1025] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:35.723033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.810099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f515-c6c1-4ab1-984c-372983eb8873 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.810393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f515-c6c1-4ab1-984c-372983eb8873 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.810648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0f515-c6c1-4ab1-984c-372983eb8873 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.812150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 511/1026] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:35.817854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b5b3b-fdbc-4262-8b64-a82812949626 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.818448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b5b3b-fdbc-4262-8b64-a82812949626 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.818448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b5b3b-fdbc-4262-8b64-a82812949626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.837752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d08a9e-dda0-4cdf-bdcf-dd5c94a61f14 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:35.837976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-803b5b3b-fdbc-4262-8b64-a82812949626 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:35.839006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-803b5b3b-fdbc-4262-8b64-a82812949626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:35.874404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:35.875668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:35.875949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:35.876221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:35.877052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:35.877400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:35.878955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:35.887018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:35.895824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 516/1027] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:35.901292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:35.918163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 512/1028] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:36.007729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821c7fd-0cf1-4142-bf7e-123a1f096303 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.036628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce096-1502-442d-b085-c28e90cdd8ea None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.037152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce096-1502-442d-b085-c28e90cdd8ea None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.037428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344ce096-1502-442d-b085-c28e90cdd8ea None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.038777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 513/1029] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:36.043498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.043895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.044136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.044238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.044412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.044515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.044788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.053331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.054790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.066063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:36.067522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:36.068030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:36.069719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:36.071805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:36.074463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 517/1030] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:41:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:36.075801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.141656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.175848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 514/1031] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:36.186165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0b8c4-094f-46eb-87ba-9a700b476277 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.192805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.224833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.225448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.225715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.225983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.226701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:36.227001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.228442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.241229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.251503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 518/1032] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:36.254671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.309629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f44c17b-4cd8-4b66-973f-0704d40b8d9a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.351924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.352550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.352832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.353086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.354210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.355823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.359809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 515/1033] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:36.364451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.370132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6e28f-0834-4f12-bccc-010140314d11 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.389897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.413547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.413547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.413547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.413547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.481594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dacd6a-1ea8-406b-b664-f388e0d6b7ab None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.489970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.491414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.496639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.520331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.520932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.521207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.521473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.522101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.523526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.545389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 516/1034] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:41:36 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:41:36.546124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.601347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 519/1035] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:36.607134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.627151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.691986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898ccf6-4e74-4021-99ef-5b1350bfdb97 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.729892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e840b40-ca2e-4482-b1d8-0b3e3f4a02c0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.737844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.738998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.739201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.739499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.740085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.741477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:36.751244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:36.752333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:36.753195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:36.753934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 517/1036] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/services/image => generated 86 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:36.761326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.778656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.779291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.779592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.779979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.790840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.792330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.801278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:36.814132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:36.815179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:36.816122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:36.816122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:36.816122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:36.816122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 520/1037] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:36.820897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.886305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11f3a3-231c-404f-9e03-db96a220bfc6 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.895821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:36.922176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.922780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.923059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.923331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.923998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:36.924284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.925645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.933924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38a069-7eda-4185-b671-dc74c57f6047 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:36.935835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 518/1038] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:36.936598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:36.972301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:36.972906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:36.973347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:36.973623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:36.975052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:36.975362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:36.976757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:36.990312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 521/1039] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:36.995857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:37.058275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:37.069329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5d701-de2a-4f9b-a1ce-780510a213e1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.108269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.108894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.109705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.110034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.110674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] RBAC: Adding query filter params (type=image) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:37.110974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.112376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.122389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 519/1040] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:37.123058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9810d-87f3-4941-a38b-ce9feb96bad9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.123932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:37.152482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:37.162275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.163018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.163287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.164386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.171203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.173631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:37.185721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:37.186657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:37.188136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 522/1041] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:37.193351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:37.239209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1425dae-5202-4c90-9bc4-bb804eb29827 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.275929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.276535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.276803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.277071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.277793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] RBAC: Adding query filter params (interface=public, service_id=555e81002f864c1da118db2714f220a4, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:37.278094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.279437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.284750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 520/1042] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:41:37 2022] GET /identity/v3/endpoints?service_id=555e81002f864c1da118db2714f220a4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:37.290228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:37.306561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441a1ef-ede0-445e-b9ef-86ef0af64d40 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.322183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:37.345111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.345725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.346002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.346276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.346970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:37.347277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.348740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.363112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 523/1043] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:37.369056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:37.411195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a29a2-8d13-4092-8dcf-d28126677103 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.426826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:37.448589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.448990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.449271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.449545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.450179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.453969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999936d-c3d5-4473-a5f4-7423910a7e6f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.460388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 521/1044] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:41:37 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:41:37.499683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0dd0c4-bf7c-497c-8304-e49d1ecf8b9c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:37.556721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:37.557653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:37.558078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:37.558501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:37.559739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] RBAC: Adding query filter params (role.id=13d9af42193040ef8329dd6fa05cbaf3, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:37.560243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:37.562848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190379d1-bde3-4992-b3a1-63814ad80576 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:37.573123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 524/1045] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:37 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=13d9af42193040ef8329dd6fa05cbaf3 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:38.561212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fa31-4598-4137-8334-64d96301883d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.561773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fa31-4598-4137-8334-64d96301883d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.561773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641fa31-4598-4137-8334-64d96301883d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.563868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 522/1046] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:38.569106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:38.569526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:38.569625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:38.588258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:38.589446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:38.665250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 525/1047] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:38.941112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fa31-4598-4137-8334-64d96301883d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.036578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.051778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641fa31-4598-4137-8334-64d96301883d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.091178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.091849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.092123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.092391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.105356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:39.111284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:39.112237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:39.113087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:39.115808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 523/1048] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:39.118534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.166407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.227919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9c1db3-6b25-4000-83ca-1d26cca10485 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.268557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.269172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.269448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.269717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.270374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:39.270674 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.272065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6bab-75df-48d4-96d5-2caf5129e141 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.285250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 526/1049] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:39.287029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.406474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c5fce3-9dde-4cef-87ac-2c89cc2385c2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.442011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.442695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.442969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.443237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] PATH_INFO: `/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.461086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] RBAC: Authorizing `identity:get_user(user_id=d24961c7ae524ab1b667b5fc6dd3f96c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.461790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136897bf-ce85-45f8-ba72-5b5386e98df6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.462095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136897bf-ce85-45f8-ba72-5b5386e98df6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.462362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136897bf-ce85-45f8-ba72-5b5386e98df6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.462543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.463872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 527/1050] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:39.467596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 524/1051] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c => generated 285 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:39.470108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8383-dc91-4c3a-8ea3-ecd568c126b9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.470368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8383-dc91-4c3a-8ea3-ecd568c126b9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.470643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715d8383-dc91-4c3a-8ea3-ecd568c126b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.470809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.480309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.492372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-715d8383-dc91-4c3a-8ea3-ecd568c126b9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:39.493578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-715d8383-dc91-4c3a-8ea3-ecd568c126b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:39.566784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 528/1052] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:39.568072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c947-5399-441e-b6a6-4c90f18b3077 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.568359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c947-5399-441e-b6a6-4c90f18b3077 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.568632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044c947-5399-441e-b6a6-4c90f18b3077 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.569894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 529/1053] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:39.575002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.575280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.575628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.593720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:39.595119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:39.601136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc11cf-4a46-4dd2-9a48-0fc301b2b8b9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.624171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.641822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.642432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.642707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.642971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.668774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 530/1054] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:39.722539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.724000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.731762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.829993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 525/1055] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:39.835770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.838253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.944602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d818c31d-0db3-4103-8793-d79298893e64 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.946918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18117a1-15ae-4012-92d1-c00222d5f5fa None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:39.952071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:39.980291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.980916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.981200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.981467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.982097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.982347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:39.982986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:39.983268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:39.983462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.983589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:39.984819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:39.986235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:39.987902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 531/1056] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:39.988705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:39.992568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:39.993576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:39.994504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 526/1057] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:39.996371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.024836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.096834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6dd54-35b9-4cdc-824c-cc5a32ea3f2f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.101267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49414b36-6371-4e9c-96a7-be20f981bdd0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.133315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.134017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.134290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.134556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.145253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.145858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.146141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.146334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:40.146450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.147153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=0c0532ae421d41ecbad4945b0146b8c0, user.id=d24961c7ae524ab1b667b5fc6dd3f96c) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:40.147461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.148902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:40.151003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:40.152032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 532/1058] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:40.152873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.166802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 527/1059] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:39 2022] GET /identity/v3/role_assignments?user.id=d24961c7ae524ab1b667b5fc6dd3f96c&scope.project.id=0c0532ae421d41ecbad4945b0146b8c0&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:40.166802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.200276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.269372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.281542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cef0847-2de4-4518-9d1b-84fc08bbfe4f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.283386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516e061-2be9-4dad-967b-a7b0ca7c0e65 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.324696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.325311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.325573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.325693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.325853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.326172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.326447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.326552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] RBAC: Adding query filter params (name=image) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:40.326709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.326803 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.327360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:40.327761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.328167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.329524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.342401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 528/1060] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:40.342584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 533/1061] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:40.342666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.343284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.452188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab74e82-419c-4fdc-805d-d7beb8e3d8cf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.459262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.463334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1e8429-3ef5-4f33-8016-a2ef1623e80f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.494938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.495603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.495876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.496142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.505144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.506060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.506060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.506329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.506923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] RBAC: Adding query filter params (type=image) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:40.507225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.508415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.508630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.509839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.513803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 529/1062] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:40.519645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:40.527460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:40.528459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:40.535114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:40.535114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:40.535114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:40.535114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 534/1063] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:40.535114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.548826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.626115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb15396-c154-4325-b7da-82443c1e5b9d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.650586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e8235-4dbb-4a61-b212-83679c688714 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.660913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.661525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.661803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.662081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.662749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.664133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.686192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 530/1064] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:41:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:41:40.710378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.711001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.711275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.711574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.712229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:40.712531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.713948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.732927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 535/1065] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:40.735079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.756874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:40.860181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bea9a9-2255-465d-a91b-7e7010911065 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:40.896032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:40.896668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:40.896941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:40.897210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:40.904979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:40.906411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:40.918022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:40.919006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:40.924180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 531/1066] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:40.926162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:40.991151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.031743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e854a7-29c0-4bb4-a224-914835165869 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.067842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.068459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.068735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.069005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.069732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:41.070034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.071446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.094319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 536/1067] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:41:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:41.095598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.176760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.201856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4bae78-a441-4364-9712-c886fbe9c3b3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.237711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.238359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.238783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.238905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.251348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.252805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:41.267151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:41.268159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:41.273832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:41.273832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:41.273832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:41.273832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 532/1068] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:41.275238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.386476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353308-b284-4a1e-ad1b-ec576b813dc4 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.410150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.423564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.424265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.424548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.424817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.425459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:41.425762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.427168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.443368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 537/1069] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:41.444889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.554013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d64e2-bc50-4cbe-9ee8-cad696591685 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.581163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:41.590483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.591109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.591383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.591677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.599152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.600605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:41.612414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:41.613289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:41.614216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:41.615197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 533/1070] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:41.619270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.726920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7043c-ca20-434d-a405-a72e3e53d35f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.761456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.762126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.762405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.762673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.763356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:41.763684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.765656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5504001-550e-4651-b40c-9dd2bd6df5f3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.783511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 538/1071] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:41.785304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:41.895153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa728c77-6fcb-4053-ab7e-f05110ea5954 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:41.929928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:41.930589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:41.930862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:41.931130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/13d9af42193040ef8329dd6fa05cbaf3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:41.933252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=640768a362f64590b7cc779353b02b6e, role_id=13d9af42193040ef8329dd6fa05cbaf3)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:41.934653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f993bd0a-2955-44eb-ab49-10b035ddbc63 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:41.948605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 534/1072] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:41 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/640768a362f64590b7cc779353b02b6e/roles/13d9af42193040ef8329dd6fa05cbaf3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:41:42.105758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c85b-e60b-486a-9788-b59795f5c8d2 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.106049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c85b-e60b-486a-9788-b59795f5c8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.106323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0c85b-e60b-486a-9788-b59795f5c8d2 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.107759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 539/1073] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:42.113923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.114206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.114483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.134037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:42.135224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:42.189134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:42.214952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 535/1074] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:42.482479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c85b-e60b-486a-9788-b59795f5c8d2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:42.531229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:42.592148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0c85b-e60b-486a-9788-b59795f5c8d2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:42.627799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:42.628430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.628706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.628975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.639288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-462f42cb-ce49-4b8b-85e0-a26fd5df0469 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:42.644095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:42.645021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:42.645862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 540/1075] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:42.652568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:42.669123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f4e1-661f-42ad-b4d2-7700de6c2e95 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.669404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f4e1-661f-42ad-b4d2-7700de6c2e95 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.669679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1f4e1-661f-42ad-b4d2-7700de6c2e95 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.671253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 541/1076] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:42.677008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.677291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.677564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.698015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:42.699208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:42.766590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f07888-9287-4163-a627-8b88f065e3bf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:42.771811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 542/1077] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:42.809253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:42.810611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.811027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.811451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.812442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:42.812900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:42.814662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:42.823608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 536/1078] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:42.829681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:42.862972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:42.936022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7bd57-39fe-4820-a17c-9d96b1596c8b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:42.971864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:42.972504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:42.972782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:42.973053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] PATH_INFO: `/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:42.974193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] RBAC: Authorizing `identity:get_user(user_id=d24961c7ae524ab1b667b5fc6dd3f96c)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:42.975668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:42.977394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 543/1079] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:42 2022] GET /identity/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:42.983062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:43.027002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:43.041081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:43.095498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770196a-902b-4d96-8a38-c777f2b17863 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:43.131708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:43.132347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.132629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.132907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.134031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:43.135509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:43.137297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 537/1080] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:42 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:43.145283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:43.155232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:43.158963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba675c-12c5-40db-956c-31bdd855f988 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:43.196459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:43.197073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.197352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.197624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.254646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c1b8a1-528b-4dd4-bbb4-d135e6c71e6d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:43.263821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:43.277518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:43.278900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:43.293096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:43.293752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.294036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.294305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0/users/d24961c7ae524ab1b667b5fc6dd3f96c/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.296250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c0532ae421d41ecbad4945b0146b8c0, user_id=d24961c7ae524ab1b667b5fc6dd3f96c, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:43.298163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:43.312521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 538/1081] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:43 2022] PUT /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0/users/d24961c7ae524ab1b667b5fc6dd3f96c/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:41:43.392939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:43.402736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 544/1082] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:43.403954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:43.528405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a533a-e3ac-471f-a0f6-19bb31f8df45 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:43.564235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:43.564962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.565312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.565654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.576932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:43.579087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-cab08d81-7560-485d-aae1-af1d5b869ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:43.593824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:43.595118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:43.596233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:43.596233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:43.596233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:43.596431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 539/1083] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:43.602197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:43.707031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93113-35c8-46b9-acc3-165e0b84bc41 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:43.741912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:43.742555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.742835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.743178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.743773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:43.744082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:43.745448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf06983-2bb0-4ea0-8795-eddf094f0b9f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:43.763509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 545/1084] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:43.880575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212864ce-1853-4d93-804f-5b4250a56157 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.881103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212864ce-1853-4d93-804f-5b4250a56157 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.881103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212864ce-1853-4d93-804f-5b4250a56157 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.882740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 540/1085] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:43.888308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:43.888815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:43.888893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:43.909970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:43.911206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:43.978182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:43.992425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 546/1086] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:44.262823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212864ce-1853-4d93-804f-5b4250a56157 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:44.286756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:44.370452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212864ce-1853-4d93-804f-5b4250a56157 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:44.404541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:44.405214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.405496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.406310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.416929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:44.422365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:44.423518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:44.424417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 541/1087] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:44.429418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:44.535291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9fa50-f628-44c5-9d86-fb65039a8b5b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:44.569261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:44.569868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.570138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.570407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.571065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:44.571363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:44.572750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:44.580545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 547/1088] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:44.586131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:44.667674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:44.686813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a8536-7133-49ca-8413-ae5779f3a54f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:44.721401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:44.722024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.722305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.722577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.732969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:44.734496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:44.748292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:44.749441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:44.750607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:44.750607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:44.750607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:44.751623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 542/1089] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:44.755322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:44.809059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:44.857131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301c848-10fa-44e4-9702-63cf0b1a6212 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:44.892157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:44.892845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:44.893030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:44.893292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:44.893936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:44.894240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:44.895636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:44.907769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 548/1090] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:44.913362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.017344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c1007-f5ff-468a-948d-5e87d0f76330 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.057907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.063969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.064541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.064814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.065087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.072839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.074249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:41:45.086017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:45.087184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:45.088201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 543/1091] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Aug 24 04:41:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:41:45.092835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.196180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa24c1a-70c9-4842-bf80-a6a425eadb45 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.209521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.231193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.231905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.232111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.232383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.233104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:45.233410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.235515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e33223-1300-476b-bf3c-3fffc3dcd151 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.253164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 549/1092] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:45.258920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.278887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092bbd-f724-441d-93ed-7e18eee9179d None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.279170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092bbd-f724-441d-93ed-7e18eee9179d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.279446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb092bbd-f724-441d-93ed-7e18eee9179d None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.281638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 550/1093] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:41:45.286634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.287006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.287237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.305726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:45.306926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:45.361880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a46b0a-a2a0-4676-97fd-850f049fd819 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.379164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 551/1094] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:45.395945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.396549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.396828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.397103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.456850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.466794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.468947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.574067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 544/1095] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:45.579834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.649141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.683105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.686246 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea024d64-e88d-4730-a577-46eba8e97e11 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.721302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.721926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.722200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.722461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.732947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.735024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.744215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:41:45.749414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:45.751055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:41:45.752100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:41:45.752100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:41:45.752100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:45.752100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 552/1096] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:45.756578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.756713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b336980-db0b-4faa-95b5-05a893beb6c0 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.791450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.792107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.792386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.792660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.808128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:41:45.813687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:45.814822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:41:45.815724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 545/1097] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:45.820777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.859367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9fa68-f4c3-4bfe-ad75-9fdbda7de6f3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.894726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.895408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.895622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.895894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.896533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:45.896834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.898196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.910221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 553/1098] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:45.915672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.922506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6540f5-ac84-452a-8653-f7eb3c65da4b None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:45.930011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:45.958238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:45.958835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:45.959111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:45.959379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:45.960110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:45.960402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:45.961833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:45.970110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 546/1099] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:45.975863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:45.991895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:46.022778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0092b99-f001-4023-8a49-7c9c89ccb02d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.058032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.059018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.059342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.059564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.067443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.068902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.077285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c537acbd-33ec-46fb-9d28-b1f725aa4f08 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:41:46.080657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:41:46.081794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:41:46.082880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 554/1100] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:41:46.087713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:46.129200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.129836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.130107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.130378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] PATH_INFO: `/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.131513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] RBAC: Authorizing `identity:get_user(user_id=d24961c7ae524ab1b667b5fc6dd3f96c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.132932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.134502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 547/1101] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:45 2022] GET /identity/v3/users/d24961c7ae524ab1b667b5fc6dd3f96c => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:46.140867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:46.161316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:46.203291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531f567-66fa-4ac7-8ede-7b85f2b9e5e9 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.226841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:46.238164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.238774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.239050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.239318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.240037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:46.240341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.241757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.245317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa691f8-d83e-450d-8f29-42d312dd9731 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.254743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 555/1102] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:46.261937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:46.284907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.285508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.285785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.286053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.356047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.357485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.368676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a7bb5-8f2c-443c-8ebd-d04deb28c562 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.398728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:46.406235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.406838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.407121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.407386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.408138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] RBAC: Adding query filter params (role.id=13d9af42193040ef8329dd6fa05cbaf3, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=640768a362f64590b7cc779353b02b6e) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:46.408445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.409898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.416234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 556/1103] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:46 2022] GET /identity/v3/role_assignments?user.id=640768a362f64590b7cc779353b02b6e&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=13d9af42193040ef8329dd6fa05cbaf3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:41:46.445841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:46.467860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 548/1104] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 04:41:46.474818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:46.584821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253233d-b881-4bf3-815a-a1118b927642 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.619559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.620199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.620470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.620739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.621857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.623267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a6b16-562b-4e1d-946d-73f4b1ecc262 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.625147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 557/1105] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:46 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:46.631284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:46.736173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe80c6-9c3f-468c-bd7b-f588d0bdfcda None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:46.770764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:46.771367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:46.771685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:46.771953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:46.772671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=0c0532ae421d41ecbad4945b0146b8c0, user.id=d24961c7ae524ab1b667b5fc6dd3f96c) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:46.772966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:46.774374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccbab56-eb1d-4c91-b0b2-0f0b9c710af8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:46.781054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 549/1106] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:46 2022] GET /identity/v3/role_assignments?user.id=d24961c7ae524ab1b667b5fc6dd3f96c&scope.project.id=0c0532ae421d41ecbad4945b0146b8c0&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:48.738810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605bef-d19b-497c-a8e6-8b0f6b85a3f8 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:48.739337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605bef-d19b-497c-a8e6-8b0f6b85a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:48.739337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63605bef-d19b-497c-a8e6-8b0f6b85a3f8 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:48.740610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 558/1107] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:48.745739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:48.746159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:48.746269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:48.764568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:48.766398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:48.810249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:48.836126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 550/1108] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:49.105152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605bef-d19b-497c-a8e6-8b0f6b85a3f8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:49.168401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:49.207910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63605bef-d19b-497c-a8e6-8b0f6b85a3f8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:49.240917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:49.241535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:49.241800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:49.242064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:49.243156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:49.244617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a5c50-40a3-471d-914d-ea47fa30b8b9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:49.246191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 559/1109] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:49.252130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:49.353226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822df8ae-a16d-47f1-9888-70b5a2f8421f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:49.386169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:49.386694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:49.386969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:49.387239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:49.387904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:49.389314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31eab3-45c4-4349-9088-06e5d9e5af2b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:49.410390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 551/1110] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:41:49 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:41:51.385570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf2eb-a7bb-4475-85f8-3bd9a43d62d8 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:51.386128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf2eb-a7bb-4475-85f8-3bd9a43d62d8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:51.386128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ebf2eb-a7bb-4475-85f8-3bd9a43d62d8 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:51.387550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 560/1111] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:51.393629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:51.394054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:51.394165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:51.412469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:51.413645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:51.438774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:51.481303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 552/1112] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:51.752082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf2eb-a7bb-4475-85f8-3bd9a43d62d8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:51.855047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ebf2eb-a7bb-4475-85f8-3bd9a43d62d8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:51.885717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:51.892287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:51.892939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:51.893283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:51.893561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] PATH_INFO: `/v3/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:51.895070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] RBAC: Authorizing `identity:get_role(role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:51.896454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:51.897760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 561/1113] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:51 2022] GET /identity/v3/roles/65fa064da25d44d5b45bbdf45796d403 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:51.903595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:52.000776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c1b96a-5bf0-4eaa-ba87-f3d4d2befa4b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:52.034028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:52.034643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:52.034920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:52.035189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] PATH_INFO: `/v3/users/8378538f53704d219824abc67304246c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:52.048936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] RBAC: Authorizing `identity:get_user(user_id=8378538f53704d219824abc67304246c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:52.052583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:52.056134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 553/1114] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:51 2022] GET /identity/v3/users/8378538f53704d219824abc67304246c => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:52.062550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:52.160851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8cbf2-6124-46ae-999e-89a02de1286b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:52.196462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:52.197066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:52.197343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:52.197614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:52.263101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:52.265466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:52.267329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:52.366446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 562/1115] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:52.372383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:52.394427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:52.473093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaa79d-1c61-4fc4-a0ca-fdf103ea5842 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:52.507675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:52.508300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:52.508577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:52.508846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:52.509950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:52.511360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f89e89-bd55-4359-92a5-65a2f5933574 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:52.513060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 554/1116] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:52 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:52.520000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:52.621152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:52.624905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631fa07-4ff7-4650-ac58-5b679b19e0c7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:52.659433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:52.660062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:52.660342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:52.660615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:52.661329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=0c0532ae421d41ecbad4945b0146b8c0, user.id=8378538f53704d219824abc67304246c) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:52.661637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:52.663062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522cba17-1e02-4936-b1fa-16d615e080e9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:52.668353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 563/1117] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:52 2022] GET /identity/v3/role_assignments?user.id=8378538f53704d219824abc67304246c&scope.project.id=0c0532ae421d41ecbad4945b0146b8c0&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:54.564881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce89c-e619-49f1-b01a-ba5365acc576 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:54.565404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce89c-e619-49f1-b01a-ba5365acc576 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:54.565404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ce89c-e619-49f1-b01a-ba5365acc576 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:54.566743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 555/1118] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:54.571862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:54.572261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:54.572412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:54.590258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:54.591447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:54.667374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 564/1119] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:41:54.948809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ce89c-e619-49f1-b01a-ba5365acc576 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:55.037635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:55.051062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ce89c-e619-49f1-b01a-ba5365acc576 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:55.085479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:55.086095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.086381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.086654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] PATH_INFO: `/v3/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.088072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] RBAC: Authorizing `identity:get_role(role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:55.089446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:55.090772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 556/1120] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:54 2022] GET /identity/v3/roles/65fa064da25d44d5b45bbdf45796d403 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:55.097645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:55.190750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:55.197790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d72fa9-e209-4df1-a9e3-79d042b89097 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:55.230699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:55.231245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.231551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.231826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] PATH_INFO: `/v3/users/8378538f53704d219824abc67304246c` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.232934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] RBAC: Authorizing `identity:get_user(user_id=8378538f53704d219824abc67304246c)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:55.234950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:55.236542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 565/1121] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:55 2022] GET /identity/v3/users/8378538f53704d219824abc67304246c => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:55.242364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:55.342922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d784-5703-4c04-a6e8-b75cb1994ddf None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:55.378414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:55.379037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.379316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.379620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.380727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:55.382154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a59eb0-981e-40ba-a1af-859b4e295e16 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:55.383828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 557/1122] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:55 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:55.389857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:55.490169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b670b-bfe2-48d4-a91f-717afbd063a3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:55.523632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9037372-c891-4871-b918-280e0c04612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:55.524278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037372-c891-4871-b918-280e0c04612b None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:55.524554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037372-c891-4871-b918-280e0c04612b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:55.524823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9037372-c891-4871-b918-280e0c04612b None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0/users/8378538f53704d219824abc67304246c/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:55.526942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037372-c891-4871-b918-280e0c04612b None admin] RBAC: Authorizing `identity:create_grant(project_id=0c0532ae421d41ecbad4945b0146b8c0, user_id=8378538f53704d219824abc67304246c, role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:55.528392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9037372-c891-4871-b918-280e0c04612b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:55.541921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 566/1123] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:41:55 2022] PUT /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0/users/8378538f53704d219824abc67304246c/roles/65fa064da25d44d5b45bbdf45796d403 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:41:57.411952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e424-e549-41ed-850b-89b25ca348ea None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:57.412531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e424-e549-41ed-850b-89b25ca348ea None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:57.412531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1e424-e549-41ed-850b-89b25ca348ea None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:57.413867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 558/1124] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:41:57.419162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:57.419603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:57.419726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:57.438568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:41:57.439770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:41:57.457217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:57.509231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 567/1125] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:41:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:41:57.781356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1e424-e549-41ed-850b-89b25ca348ea None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:57.808476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:57.886720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1e424-e549-41ed-850b-89b25ca348ea None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:57.920415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:57.921393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:57.921670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:57.921942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] PATH_INFO: `/v3/roles/65fa064da25d44d5b45bbdf45796d403` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:57.923320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] RBAC: Authorizing `identity:get_role(role_id=65fa064da25d44d5b45bbdf45796d403)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:57.924682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:57.925982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 559/1126] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:57 2022] GET /identity/v3/roles/65fa064da25d44d5b45bbdf45796d403 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:57.932089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.030733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1bde-2ce3-4f11-b658-c6fa43e6a1b4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:58.065559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:58.066201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.066593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.066964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] PATH_INFO: `/v3/users/8378538f53704d219824abc67304246c` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.068284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] RBAC: Authorizing `identity:get_user(user_id=8378538f53704d219824abc67304246c)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:58.069942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:58.071530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 568/1127] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:41:57 2022] GET /identity/v3/users/8378538f53704d219824abc67304246c => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:58.078482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.168396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:58.178193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b760fa0-f27f-436e-98ed-4a06fc831ded None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:58.212593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:58.213191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.213466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.213736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.283167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:58.284650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:58.378605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:58.388166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 560/1128] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:41:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:41:58.394157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.416255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:41:58.494447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd8c02-3f34-4c2f-81b1-20040e44139f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:58.528773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:58.529391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.529667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.530599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] PATH_INFO: `/v3/projects/0c0532ae421d41ecbad4945b0146b8c0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.531930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] RBAC: Authorizing `identity:get_project(project_id=0c0532ae421d41ecbad4945b0146b8c0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:58.533355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f28dc6-0fd8-4f09-b7a9-02dfee13339d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:58.534951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 569/1129] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:41:58 2022] GET /identity/v3/projects/0c0532ae421d41ecbad4945b0146b8c0 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:41:58.541141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:41:58.638430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bfaa93-7be7-4e02-8f94-8547bed55fb3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:41:58.673110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:41:58.673705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:41:58.673979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:41:58.674245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:41:58.674965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] RBAC: Adding query filter params (role.id=65fa064da25d44d5b45bbdf45796d403, scope.project.id=0c0532ae421d41ecbad4945b0146b8c0, user.id=8378538f53704d219824abc67304246c) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:41:58.675268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:41:58.676711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56e6d9-6fee-4445-a556-1dc32f42384b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:41:58.682521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 561/1130] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:41:58 2022] GET /identity/v3/role_assignments?user.id=8378538f53704d219824abc67304246c&scope.project.id=0c0532ae421d41ecbad4945b0146b8c0&role.id=65fa064da25d44d5b45bbdf45796d403 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:00.654478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5b4e-198b-46f3-b7ab-b9a26eb7ca2b None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:00.655645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5b4e-198b-46f3-b7ab-b9a26eb7ca2b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:00.655645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad5b4e-198b-46f3-b7ab-b9a26eb7ca2b None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:00.656996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 570/1131] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:00.662229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:00.662636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:00.662774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:00.680872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:00.682061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:00.731809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:00.749033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 562/1132] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:01.032386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5b4e-198b-46f3-b7ab-b9a26eb7ca2b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:01.153125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:01.178824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad5b4e-198b-46f3-b7ab-b9a26eb7ca2b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:01.220807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:01.221449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:01.221726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:01.221994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:01.223153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:01.224613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456b7f2-8c8a-40d8-ac67-4256b97fd503 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:01.226184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 571/1133] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:01.233071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:01.350199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762473e-e78d-4838-8e53-9706a5c1dc6a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:01.390184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:01.390834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:01.391109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:01.391379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:01.392375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:01.394821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590e95d-8a1a-47af-bd25-4e93623754fb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:01.427419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 563/1134] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:42:01 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:03.446451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99f9d-cf95-4fbf-a965-d388fb59dca6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.447009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99f9d-cf95-4fbf-a965-d388fb59dca6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.447009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d99f9d-cf95-4fbf-a965-d388fb59dca6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.448380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 572/1135] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:03.454299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.454760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.454877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.473696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:03.474868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:03.503499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:03.542752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 564/1136] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:42:03.812297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99f9d-cf95-4fbf-a965-d388fb59dca6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:03.931860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d99f9d-cf95-4fbf-a965-d388fb59dca6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:03.967925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:03.968553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:03.968831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:03.969106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:03.970245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:03.971849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36311eb0-fc18-4827-a7c6-b7119ba82c20 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:03.973474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 573/1137] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:42:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:03.979267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:04.081526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9b534-8710-41a4-89f4-19e9262d16da None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:04.114708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:04.115302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:04.115598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:04.115867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:04.116500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:04.117909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983f6e15-2235-4bbb-b2b2-bf053b021a0b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:04.139113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 565/1138] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:42:03 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:06.127334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049817-18cb-4fb5-b303-66e942592156 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.128044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049817-18cb-4fb5-b303-66e942592156 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.128044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a049817-18cb-4fb5-b303-66e942592156 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:06.129227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 574/1139] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:06.134651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.135161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.135297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:06.154703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:06.155993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:06.173626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:06.227272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 566/1140] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 04:42:06.510616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049817-18cb-4fb5-b303-66e942592156 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:06.540881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:06.624297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a049817-18cb-4fb5-b303-66e942592156 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:06.659480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:06.660196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.660470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.660739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:06.671138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:06.675904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:06.676837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:06.677794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 575/1141] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:42:06.683249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:06.785668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e69706-0246-40db-b5f1-526e3a017f6f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:06.832361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:06.832971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.833245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.833511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:06.834171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:06.834466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:06.835855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:06.845065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 567/1142] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:06.850995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:06.941461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:06.958870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630714-4e25-4009-84b7-9d04f0a20a96 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:06.994829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:06.995452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:06.995754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:06.996022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] PATH_INFO: `/v3/users/54df4d07f1fa483690e2fa3cbc4493eb` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:07.009621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] RBAC: Authorizing `identity:get_user(user_id=54df4d07f1fa483690e2fa3cbc4493eb)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:07.011056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:07.012716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 576/1143] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:06 2022] GET /identity/v3/users/54df4d07f1fa483690e2fa3cbc4493eb => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:07.019455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:07.039621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:07.125856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2acf6-af1c-495b-82e1-6006b80defcb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:07.160472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:07.161165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:07.161486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:07.161759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:07.231703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:07.234044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:07.251720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:07.350104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 568/1144] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:42:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:07.356214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:07.463128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03ccf8-4205-4312-bb3c-03c5641b15c8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:07.503436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:07.504117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:07.504394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:07.504667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] PATH_INFO: `/v3/projects/f50a61bf06fa42459f5d679112018c6d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:07.505845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] RBAC: Authorizing `identity:get_project(project_id=f50a61bf06fa42459f5d679112018c6d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:07.507288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b280b-935a-487c-9e96-a7bb0db27be2 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:07.509010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 577/1145] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:07 2022] GET /identity/v3/projects/f50a61bf06fa42459f5d679112018c6d => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:07.519414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:07.632277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4dc795-f066-4bc5-9d1a-adca1cfe5092 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:07.649027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:07.668772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:07.669379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:07.669659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:07.669993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:07.671243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=f50a61bf06fa42459f5d679112018c6d, user.id=54df4d07f1fa483690e2fa3cbc4493eb) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:07.671581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:07.673031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0470b71-c3c6-4976-a0ea-cf4a81af70d2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:07.678715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 569/1146] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:42:07 2022] GET /identity/v3/role_assignments?user.id=54df4d07f1fa483690e2fa3cbc4493eb&scope.project.id=f50a61bf06fa42459f5d679112018c6d&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:09.600037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa70de-b519-428c-8911-c46f93e7aaec None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:09.600578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa70de-b519-428c-8911-c46f93e7aaec None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:09.600578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aa70de-b519-428c-8911-c46f93e7aaec None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:09.601888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 578/1147] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:09.606867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:09.607314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:09.607434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:09.625825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:09.626997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:09.695720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 570/1148] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:09.964382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa70de-b519-428c-8911-c46f93e7aaec None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:09.977034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.069630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aa70de-b519-428c-8911-c46f93e7aaec None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:10.103849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:10.104467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:10.104741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:10.105011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:10.115762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:10.120445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:10.121523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:10.122570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 579/1149] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:42:10.128245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:10.225344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97873690-d1b3-4e45-abe2-0798e13368f8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:10.236321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.259894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:10.260490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:10.260761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:10.261033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:10.261685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:10.261976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:10.263315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:10.271173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 571/1150] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:10.277141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:10.346854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.385885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2a75f-0ead-4d81-9f19-520e1db27e82 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:10.421622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:10.422283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:10.422555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:10.422822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] PATH_INFO: `/v3/users/54df4d07f1fa483690e2fa3cbc4493eb` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:10.423977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] RBAC: Authorizing `identity:get_user(user_id=54df4d07f1fa483690e2fa3cbc4493eb)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:10.425407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:10.426981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 580/1151] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:10 2022] GET /identity/v3/users/54df4d07f1fa483690e2fa3cbc4493eb => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:10.433892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:10.549876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1b7eb-2710-46ea-b441-b9ef7a18deb2 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:10.586074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:10.586708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:10.586987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:10.587261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] PATH_INFO: `/v3/projects/f50a61bf06fa42459f5d679112018c6d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:10.588402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] RBAC: Authorizing `identity:get_project(project_id=f50a61bf06fa42459f5d679112018c6d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:10.589827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097d077-2baa-4292-a018-59e51258aea0 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:10.591494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 572/1152] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:10 2022] GET /identity/v3/projects/f50a61bf06fa42459f5d679112018c6d => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:42:10.598883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:10.707804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6c621-64ce-40b9-a822-677c5f6541cd None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:10.744810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:10.745415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:10.745690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:10.745960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] PATH_INFO: `/v3/projects/f50a61bf06fa42459f5d679112018c6d/users/54df4d07f1fa483690e2fa3cbc4493eb/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:10.747954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] RBAC: Authorizing `identity:create_grant(project_id=f50a61bf06fa42459f5d679112018c6d, user_id=54df4d07f1fa483690e2fa3cbc4493eb, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:10.749818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3d2b9-6f03-4c1c-a17a-d8afc0733364 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:10.757987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:10.764136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 581/1153] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:42:10 2022] PUT /identity/v3/projects/f50a61bf06fa42459f5d679112018c6d/users/54df4d07f1fa483690e2fa3cbc4493eb/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:12.651367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca251-7748-444a-9edd-0f52f7891bb0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:12.651935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca251-7748-444a-9edd-0f52f7891bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:12.651935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dca251-7748-444a-9edd-0f52f7891bb0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:12.653296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 573/1154] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:12.659323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:12.659933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:12.659933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:12.680480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:12.681704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:12.756407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 582/1155] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:13.023913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca251-7748-444a-9edd-0f52f7891bb0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:13.068240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:13.131073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dca251-7748-444a-9edd-0f52f7891bb0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:13.168693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:13.169321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.170127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.170462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.181656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:13.186988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:13.188406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:42:13.189434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 574/1156] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:42:13.194535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:13.298946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65707df-fe45-4162-8785-e7a9fe7e7e64 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:13.326951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:13.336759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:13.336759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.337204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.337493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.338203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:13.338477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:13.339882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:13.350464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 583/1157] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:13.356515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:13.466282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:13.472153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0845a-b3b9-42b9-a33f-60fa17292689 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:13.533341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:13.534419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.534917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.535413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] PATH_INFO: `/v3/users/54df4d07f1fa483690e2fa3cbc4493eb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.537428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] RBAC: Authorizing `identity:get_user(user_id=54df4d07f1fa483690e2fa3cbc4493eb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:13.540276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:13.543457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 575/1158] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:13 2022] GET /identity/v3/users/54df4d07f1fa483690e2fa3cbc4493eb => generated 286 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:13.550646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:13.684806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a90ae-52ca-4fe3-8e3c-56c705f3bcb0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:13.724360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:13.724966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:13.725240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:13.725506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:13.786132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:13.797217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:13.797217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:13.912225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 584/1159] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:42:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:13.918081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:14.025079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022daf7d-8cd3-42a1-a6ed-ae40f32642bd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:14.063063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:14.063745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:14.064026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:14.064300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] PATH_INFO: `/v3/projects/f50a61bf06fa42459f5d679112018c6d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:14.065484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] RBAC: Authorizing `identity:get_project(project_id=f50a61bf06fa42459f5d679112018c6d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:14.066930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078d0ae-0b88-489d-b212-b082a12e495a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:14.068672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 576/1160] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:13 2022] GET /identity/v3/projects/f50a61bf06fa42459f5d679112018c6d => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:14.075271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:14.172987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:14.183385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1ad7b-6b60-4e8e-b12a-8bbf9a1f01da None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:14.220119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:14.220734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:14.221013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:14.221284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:14.222010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=f50a61bf06fa42459f5d679112018c6d, user.id=54df4d07f1fa483690e2fa3cbc4493eb) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:14.222317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:14.223779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc7ae7-2376-4d8c-b2b4-3eff2c75c9eb None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:14.230219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 585/1161] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:42:14 2022] GET /identity/v3/role_assignments?user.id=54df4d07f1fa483690e2fa3cbc4493eb&scope.project.id=f50a61bf06fa42459f5d679112018c6d&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:16.212542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98442d-0dbe-4407-ad38-065ec0e2d6a0 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.213119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98442d-0dbe-4407-ad38-065ec0e2d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.213119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98442d-0dbe-4407-ad38-065ec0e2d6a0 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.214544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 577/1162] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:16.220373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.220848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.220952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.239351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:16.240583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:16.310977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 586/1163] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:16.579762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98442d-0dbe-4407-ad38-065ec0e2d6a0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:16.618086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:16.690241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98442d-0dbe-4407-ad38-065ec0e2d6a0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:16.737222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:16.737840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:16.738121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:16.738450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:16.807853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:16.809289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:16.845895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:16.911261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 578/1164] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:42:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:16.917672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.002991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:17.020627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394cd770-2801-4ac5-b488-038ff4784cd3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.056712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.057354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.057627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.057902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.066602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.068135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-f336e5fe-29b3-4ab7-a19d-a7c134d74344 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:17.079815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:17.081178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:17.082325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 587/1165] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:42:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:42:17.090238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:17.203200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca84b40-583e-4183-be92-d0eb3b4c41f1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:17.249471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:17.250121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:17.250335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:17.250602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:17.251233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:17.251574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:17.252922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81c125-d66d-4636-acb3-8a0f0f672ab4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:17.255414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:17.261063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 579/1166] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Aug 24 04:42:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:19.249195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee115a-418b-4fbc-87e4-0373c3341dd1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.249739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee115a-418b-4fbc-87e4-0373c3341dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.249739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee115a-418b-4fbc-87e4-0373c3341dd1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.251233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 588/1167] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:19.256706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550e83-dd4a-4652-9e67-6e0e2f55fcd9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.257155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550e83-dd4a-4652-9e67-6e0e2f55fcd9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.257272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550e83-dd4a-4652-9e67-6e0e2f55fcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.277527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b2550e83-dd4a-4652-9e67-6e0e2f55fcd9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:19.279412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b2550e83-dd4a-4652-9e67-6e0e2f55fcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:19.353599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 580/1168] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:19.630715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee115a-418b-4fbc-87e4-0373c3341dd1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:19.749671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee115a-418b-4fbc-87e4-0373c3341dd1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:19.786211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:19.786819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:19.787094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:19.787362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:19.788064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:19.789430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba75af96-5398-4ea2-b014-9ce34315aa5e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:19.806806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 589/1169] 10.222.0.85 () {60 vars in 1138 bytes} [Wed Aug 24 04:42:19 2022] POST /identity/v3/domains => generated 267 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:42:21.795629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9be8-7d05-4db0-a3d8-3575ebd03112 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.796174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9be8-7d05-4db0-a3d8-3575ebd03112 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.796174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9be8-7d05-4db0-a3d8-3575ebd03112 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.797553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 581/1170] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:21.804357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:21.804840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:21.805322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:21.814018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:21.825340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:21.827206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:21.895833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 590/1171] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:22.176469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9be8-7d05-4db0-a3d8-3575ebd03112 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:22.287132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9be8-7d05-4db0-a3d8-3575ebd03112 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:22.316689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:22.323037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:22.324532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:22.324806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:22.325073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] PATH_INFO: `/v3/domains/49549b6a770441338d2dd2c94f6736da` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:22.335940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=49549b6a770441338d2dd2c94f6736da)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:22.337371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1387af-7c66-4333-84bd-9497a8ad47c8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:22.339012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 582/1172] 10.222.0.85 () {56 vars in 1183 bytes} [Wed Aug 24 04:42:22 2022] GET /identity/v3/domains/49549b6a770441338d2dd2c94f6736da => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:22.344953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:22.445078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08838b-df27-4a53-b2b1-ca39061948d6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:22.480109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:22.480835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:22.481033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:22.481249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:22.482545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:22.484080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9393a5-7616-422e-a583-9226849a1d13 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:22.488877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:22.511600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 591/1173] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:42:22 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:24.488841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412f0b-6148-41b0-b7c9-d311734d9c44 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.489335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412f0b-6148-41b0-b7c9-d311734d9c44 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.489438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f412f0b-6148-41b0-b7c9-d311734d9c44 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.490775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 583/1174] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:24.496054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:24.496474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:24.496607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:24.515830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:24.517042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:24.597683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 592/1175] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:24.876762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412f0b-6148-41b0-b7c9-d311734d9c44 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:24.988626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f412f0b-6148-41b0-b7c9-d311734d9c44 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.024732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.025367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.025646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.025922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] PATH_INFO: `/v3/domains/49549b6a770441338d2dd2c94f6736da` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.027061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=49549b6a770441338d2dd2c94f6736da)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.028655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdc8f1-266c-4652-97ce-dc6cda0c6dfa None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.030310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 584/1176] 10.222.0.85 () {56 vars in 1183 bytes} [Wed Aug 24 04:42:24 2022] GET /identity/v3/domains/49549b6a770441338d2dd2c94f6736da => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:25.038331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:25.155709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a4bfb-11f8-46c3-a87b-d6eb83e3aab7 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:25.174330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:25.195021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:25.195669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:25.195947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:25.196219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:25.196875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:25.198300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a92f566-64cf-4f7f-b79b-218c9463562b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:25.221649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 593/1177] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:42:25 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:42:27.211082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1ffc-67de-4e5d-bf5b-497834957c47 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.211763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1ffc-67de-4e5d-bf5b-497834957c47 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.211763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d1ffc-67de-4e5d-bf5b-497834957c47 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.212990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 585/1178] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:27.219150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.219638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.219748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.238290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:27.239583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:27.307586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 594/1179] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:27.576029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1ffc-67de-4e5d-bf5b-497834957c47 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.642526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.692696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d1ffc-67de-4e5d-bf5b-497834957c47 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.729523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.730159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.730440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.730705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.742267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:27.747518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:27.749474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:42:27.750537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 586/1180] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:42:27.755670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:27.860817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c2e3-b635-4b2e-b40c-504c8fa394d8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:27.862699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:27.905148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:27.905903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:27.906181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:27.906450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:27.907120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:27.907426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:27.908908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:27.917930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 595/1181] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:27.924244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:28.033686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1583c9-2844-4f0d-ab0f-c91bec15bd0f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:28.051716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:28.078215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:28.078854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.079132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.079402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] PATH_INFO: `/v3/users/9487fcd3377945b092ee77ce0fad8b50` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.093600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] RBAC: Authorizing `identity:get_user(user_id=9487fcd3377945b092ee77ce0fad8b50)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:28.095046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:28.096856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 587/1182] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:27 2022] GET /identity/v3/users/9487fcd3377945b092ee77ce0fad8b50 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:28.103097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:28.217804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22323ae6-d8f8-4b9f-bdd6-86b37feadef8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:28.255867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:28.256661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.256770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.257013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.290910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:28.331494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:28.332965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:28.439409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 596/1183] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:42:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:28.445918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:28.555929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae741d70-a083-4f6b-a4f6-d7e2ba837c16 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:28.592257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:28.592930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.593212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.593490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] PATH_INFO: `/v3/projects/5ceb19f95b90430e99930ca218ade78a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.594848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] RBAC: Authorizing `identity:get_project(project_id=5ceb19f95b90430e99930ca218ade78a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:28.596365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf434ad-8d13-4af2-97d6-595577057282 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:28.598193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 588/1184] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:28 2022] GET /identity/v3/projects/5ceb19f95b90430e99930ca218ade78a => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:42:28.605148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:28.691243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:28.750275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d71d5-8c1a-4a56-9878-5a04a09a33bf None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:28.790513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:28.791131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:28.791411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:28.791717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:28.792459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=5ceb19f95b90430e99930ca218ade78a, user.id=9487fcd3377945b092ee77ce0fad8b50) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:28.792770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:28.795205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efd4e0a-8a69-4f22-952a-6ef233875a34 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:28.801716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 597/1185] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:42:28 2022] GET /identity/v3/role_assignments?user.id=9487fcd3377945b092ee77ce0fad8b50&scope.project.id=5ceb19f95b90430e99930ca218ade78a&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:30.749485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd838-383d-4954-a323-c4d916edc999 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:30.749988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd838-383d-4954-a323-c4d916edc999 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:30.749988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afbd838-383d-4954-a323-c4d916edc999 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:30.751301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 589/1186] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:30.757209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:30.757718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:30.757808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:30.779884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:30.781139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:30.859796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 598/1187] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:31.136526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbd838-383d-4954-a323-c4d916edc999 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.192022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.253935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afbd838-383d-4954-a323-c4d916edc999 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.290900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.291572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.291853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.292125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.304325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:31.309092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:31.310855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:42:31.312434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 590/1188] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:42:31.319274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.385727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.433950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad447a0-d523-45c1-b461-dde55803f7ce None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.476723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.477309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.477580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.478173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.478510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:31.478898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.480230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.491541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 599/1189] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:31.498539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.609533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa318c0-8500-4505-9852-e3aebe1591bc None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.612012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.646134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.646828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.647212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.647564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] PATH_INFO: `/v3/users/9487fcd3377945b092ee77ce0fad8b50` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.648766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] RBAC: Authorizing `identity:get_user(user_id=9487fcd3377945b092ee77ce0fad8b50)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.650261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.651943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 591/1190] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/users/9487fcd3377945b092ee77ce0fad8b50 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:31.661679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.772439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf902ccf-8e00-43c9-8e8a-8f30d5b91369 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.797573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:31.814098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.814742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.815018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.815290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] PATH_INFO: `/v3/projects/5ceb19f95b90430e99930ca218ade78a` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.816457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] RBAC: Authorizing `identity:get_project(project_id=5ceb19f95b90430e99930ca218ade78a)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.817921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9f2d5-ef8e-4132-b0b6-2630be294822 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.819827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 600/1191] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:31 2022] GET /identity/v3/projects/5ceb19f95b90430e99930ca218ade78a => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:31.826483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:31.937363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ed447-259b-4efb-a3de-c6326dc29846 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:31.974971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:31.975670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:31.975949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:31.976218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] PATH_INFO: `/v3/projects/5ceb19f95b90430e99930ca218ade78a/users/9487fcd3377945b092ee77ce0fad8b50/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:31.978245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] RBAC: Authorizing `identity:create_grant(project_id=5ceb19f95b90430e99930ca218ade78a, user_id=9487fcd3377945b092ee77ce0fad8b50, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:31.979706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f68e1fa-5032-4c2a-bd64-bb79cdc840df None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:31.994759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 592/1192] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:42:31 2022] PUT /identity/v3/projects/5ceb19f95b90430e99930ca218ade78a/users/9487fcd3377945b092ee77ce0fad8b50/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:42:33.986729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1553cb-3e98-4785-8890-be6e14485c58 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:33.987363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1553cb-3e98-4785-8890-be6e14485c58 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:33.987363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1553cb-3e98-4785-8890-be6e14485c58 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:33.988646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 601/1193] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:42:33.996645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:33.997200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:33.997200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.016650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:42:34.017885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:42:34.048946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:34.098296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 593/1194] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:42:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:42:34.384547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1553cb-3e98-4785-8890-be6e14485c58 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:34.524404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1553cb-3e98-4785-8890-be6e14485c58 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:34.575811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:34.576845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.577257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.577682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.597308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:42:34.608330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:42:34.609524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:42:34.610565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 602/1195] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:42:34.616037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:34.732698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124586a-1b9d-4dd0-919e-66743a009055 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:34.771434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:34.772090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.772368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.772636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.773310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:34.773615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:34.775009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:34.784525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 594/1196] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:34.791911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:34.850724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:34.913019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68c76e-7891-48a5-b759-91593ed560df None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:34.953959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:34.954606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:34.954881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:34.955147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] PATH_INFO: `/v3/users/9487fcd3377945b092ee77ce0fad8b50` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:34.956611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] RBAC: Authorizing `identity:get_user(user_id=9487fcd3377945b092ee77ce0fad8b50)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:34.958071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:34.959809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 603/1197] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Aug 24 04:42:34 2022] GET /identity/v3/users/9487fcd3377945b092ee77ce0fad8b50 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:34.967322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:34.996895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.087238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee52a3-2e08-473a-9245-779145c2e66a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:35.126343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:35.127030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:35.127357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:35.127709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:35.207977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:35.209437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:35.236997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.327605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 595/1198] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:42:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:42:35.333870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:35.457216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00de2f-da33-4160-ab8b-8755323f4de3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:35.477006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.502773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:35.503541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:35.503872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:35.504192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] PATH_INFO: `/v3/projects/5ceb19f95b90430e99930ca218ade78a` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:35.505530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] RBAC: Authorizing `identity:get_project(project_id=5ceb19f95b90430e99930ca218ade78a)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:35.507000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b7f69-1168-4a94-8e3e-3f0cd7cccca5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:35.508780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 604/1199] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Aug 24 04:42:35 2022] GET /identity/v3/projects/5ceb19f95b90430e99930ca218ade78a => generated 361 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:42:35.515940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:42:35.633090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841871bb-6746-43bb-9f93-b366d086167e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:42:35.661499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:35.674344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:42:35.674966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:42:35.675250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:42:35.675552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:42:35.676299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=5ceb19f95b90430e99930ca218ade78a, user.id=9487fcd3377945b092ee77ce0fad8b50) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:42:35.676605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:42:35.678057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e6f2ea-6dab-4c53-bc93-76223757906d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:42:35.685831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 596/1200] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:42:35 2022] GET /identity/v3/role_assignments?user.id=9487fcd3377945b092ee77ce0fad8b50&scope.project.id=5ceb19f95b90430e99930ca218ade78a&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:42:45.497568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=8 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:42:45.681816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:33.325141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e818-2de2-4820-b385-a7a6ba8533cb None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:33.325735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e818-2de2-4820-b385-a7a6ba8533cb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:33.325735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27e818-2de2-4820-b385-a7a6ba8533cb None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:33.327304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 605/1201] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:33.333994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:33.334518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:33.334518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:33.355681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:33.357241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:33.452334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 597/1202] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:33.766848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e818-2de2-4820-b385-a7a6ba8533cb None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:33.902061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27e818-2de2-4820-b385-a7a6ba8533cb None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:33.943287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:33.944121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:33.944448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:33.944807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:33.961098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:33.963826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:33.985027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:33.986173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:33.987665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:33.987665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:33.987665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:33.987665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 606/1203] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:33.992328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:34.111886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddbd82-b228-4167-93e0-9bad3870abad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:34.147730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:34.155242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:34.156140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:34.156630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:34.157069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:34.157848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:34.158130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:34.159593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ddd533-5a17-40ea-86ad-66e8fa0e637b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:34.172754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 598/1204] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:34.178939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:34.250744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:34.307734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1502147-4c5d-4e8f-8054-037c79e03ad6 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:34.354438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:34.355824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:34.356303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:34.356729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:34.357563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:34.359269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb5b71-7b5f-4e5d-b9cf-923e674fae39 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:34.387114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 607/1205] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Aug 24 04:43:34 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:43:36.618689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4a56-3386-4fc5-9350-b46758d4e534 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:36.618689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4a56-3386-4fc5-9350-b46758d4e534 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:36.618689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad4a56-3386-4fc5-9350-b46758d4e534 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:36.618689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 599/1206] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:36.625661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:36.626215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:36.626215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:36.645853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:36.647195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:36.726598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 608/1207] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:37.015043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad4a56-3386-4fc5-9350-b46758d4e534 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.148006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad4a56-3386-4fc5-9350-b46758d4e534 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.191011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:37.191694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.192009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.192239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.204747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:43:37.209889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:37.210856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:37.212584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 600/1208] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:37.217991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.266151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.341926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5fce3-392b-41fe-9288-d0c8a320e62e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.379634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:37.380277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.380547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.380814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.381553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:37.381856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:37.383228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:37.392906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 609/1209] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:37.400209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.460413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.525820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd14d1-3918-4475-9cd2-971647f4e7cd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.572241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:37.573051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.573315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.573588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.590648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:37.592250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:37.611498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:37.612750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:37.613694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:37.613694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:37.613694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:37.613694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 601/1210] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:37.618973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.732740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:37.736460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2be13-42fd-4345-8854-84b1e51c4453 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.779141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:37.779807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:37.780092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:37.780367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:37.781115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:37.781488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:37.783043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:37.799836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 610/1211] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:37.806152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:37.959867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e9460f-2c9c-406f-958f-3e787686dfe9 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:37.962286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.003008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:38.003708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.003997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.004292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.016488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:38.016488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:43:38.028497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:38.029628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:38.031344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 602/1212] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:38.035897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.176602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2f76-efa3-4a0c-9e60-a54ec5610e67 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:38.220191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:38.221225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.221661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.222094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.223336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:38.223911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:38.226428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:38.250578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 611/1213] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:38.256665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.384513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1070b-ae2a-440f-ab0c-b3484a5e2598 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:38.426856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:38.427485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.427841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.428113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.476557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.522807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:38.524462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:38.639891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 603/1214] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:43:38.645813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.670725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:38.777088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c203e34-2fc8-468b-a140-88d6268d9ea5 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:38.825025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:38.825660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:38.825936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:38.826207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:38.840290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:38.841725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:38.859906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:38.860989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:38.862273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:38.862273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:38.862273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:38.862273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 612/1215] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:43:38.867280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:38.957962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.012196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a83352-df11-485e-ab13-db1f45c21575 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:39.078162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:39.078776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.079071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.079313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:39.079994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:39.080397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:39.081606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:39.097620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 604/1216] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:39.104311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:39.186356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.222001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413b6a4-4d38-4a20-a23b-e1d65279d5b1 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:39.262073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:39.262692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.262967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.263238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:39.270844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:39.272310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:43:39.287022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:39.288851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:39.291280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:39.293783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 613/1217] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:39.295889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:39.478833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ed2b1-ebad-4f46-bf72-c3a38b0edf38 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:39.512946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.527066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:39.528608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.528608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.528608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:39.529254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:39.529556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:39.531321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a12ac5-5f06-456e-b49a-ac48e191819b None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:39.548891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 605/1218] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:39.556389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:39.683166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ca1d0-e409-48b6-86c0-865bc9818d40 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:39.716157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:39.723090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:39.724307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:39.724307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:39.724555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:39.725309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=f1af6c98265e44eab90317693fb7f1b2) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:39.725680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:39.727160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4b58-8af9-434b-8ebf-db52a01da488 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:39.738600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 614/1219] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:43:39 2022] GET /identity/v3/role_assignments?user.id=f1af6c98265e44eab90317693fb7f1b2&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:41.885500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581abb-98f4-4932-829d-45f899be4638 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:41.886096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581abb-98f4-4932-829d-45f899be4638 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:41.886096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef581abb-98f4-4932-829d-45f899be4638 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:41.887403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 606/1220] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:41.893084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:41.893621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:41.893621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:41.913565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:41.915433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:41.999044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 615/1221] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:42.322392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef581abb-98f4-4932-829d-45f899be4638 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:42.438030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef581abb-98f4-4932-829d-45f899be4638 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:42.476065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:42.476696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:42.476972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:42.478013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:42.490756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:43:42.496326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:42.497576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:42.498744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 607/1222] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:42.503946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:42.621084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d16cf6-b1c1-4a73-aea9-f03038151b67 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:42.649479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:42.662237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:42.663000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:42.663282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:42.663713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:42.664407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] RBAC: Adding query filter params (name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:42.665265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:42.666926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:42.676626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 616/1223] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:43:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:42.682783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:42.729565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:42.799954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a72a7f-3163-437c-8203-501cb82f0ec7 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:42.835583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:42.836204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:42.836539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:42.837403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:42.848137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:42.849554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:42.866216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:42.867582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:42.869256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:42.869256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:42.869256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:42.869256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 608/1224] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:42.874136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:42.991662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b0666-e69a-4108-8c2c-d6475600e982 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.030348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.030965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.031230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.031524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.032293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:43.032706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.034270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.048175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 617/1225] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:43.054480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.157605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.166596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77830e-46cf-4d77-8c3f-60438ae1720f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.206733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.207354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.207658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.207923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.215815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.217488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:43:43.229270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:43.230475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:43.231654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 609/1226] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:43.238525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.302506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.360878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e12a99-2c47-47c8-a0d4-1b876a577e6f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.401535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.402140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.402413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.402679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.403552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:43.403853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.405518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.424231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 618/1227] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:43.431201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.560706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a2029-8485-416f-9238-6147ae5c8beb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.597410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.598433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.600050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.600050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.615188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.616700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:43.633949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:43.639914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:43.641079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:43.641079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:43.641079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:43.641079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 610/1228] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:43:43.641357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.753016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ccf99-1021-48d4-8139-232bd845538e None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.755585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.805235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.806524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.806858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.807163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.807962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:43.808290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.809686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:43.823437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 619/1229] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:43.829061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:43.839148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:43.952490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c47c66b-2660-4253-b9ae-38b98950fbe4 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:43.988753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:43.989379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:43.989666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:43.989935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:43.997720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:43.999263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:43:44.011570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:44.012680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:44.013634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 611/1230] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:43:44.018753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:44.141135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ffb2d6-821a-471b-a86c-31f3e3d2a84d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:44.178437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:44.179050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:44.179325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:44.179638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:44.181048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:44.181368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:44.182805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a51ed1-c2fe-4442-a0c7-2051840cdf1d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:44.197997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 620/1231] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:44.205112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:44.273964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:44.315998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944acd8-c6ba-41df-ba17-a1b513a0c08e None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:44.356524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:44.357434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:44.357771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:44.358052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/f1af6c98265e44eab90317693fb7f1b2/roles/827566e44d2a49feba52269f4f4e071e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:44.375088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=f1af6c98265e44eab90317693fb7f1b2, role_id=827566e44d2a49feba52269f4f4e071e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:44.376541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274b4b5-fff3-4f97-8fd5-1dc4e99828ef None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:44.389652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 612/1232] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:43:44 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/f1af6c98265e44eab90317693fb7f1b2/roles/827566e44d2a49feba52269f4f4e071e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:43:46.412572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b888-ba55-4bb0-9967-967bbadaae28 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:46.413231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b888-ba55-4bb0-9967-967bbadaae28 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:46.413231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7b888-ba55-4bb0-9967-967bbadaae28 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:46.415134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 621/1233] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:46.421783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:46.422291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:46.422749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:46.441490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:46.442704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:46.519670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 613/1234] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:46.809393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7b888-ba55-4bb0-9967-967bbadaae28 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:46.836981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:46.922641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7b888-ba55-4bb0-9967-967bbadaae28 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:46.965391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:46.966026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:46.966302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:46.966598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:46.977794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:43:46.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:46.983780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:46.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 622/1235] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Aug 24 04:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:46.991941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.040783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:47.097939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8049ca5-23fe-4db0-8137-160c3529deff None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:47.135301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:47.135959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.136246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.136523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.137302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] RBAC: Adding query filter params (name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:47.137546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:47.138940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:47.148264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 614/1236] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Aug 24 04:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:47.154325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.250327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:47.268628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dc8f6b-7398-4584-ad7c-253eae8bb643 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:47.313045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:47.313680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.313958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.314330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.326176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:47.327665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:47.344333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:47.346621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:47.348828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:47.348828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:47.348828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:47.348828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 623/1237] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:43:47.352977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.465421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2b36a-608d-4e82-8e09-a12eb1340c6a None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:47.474974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:47.502998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:47.503969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.504455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.504757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.505803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:47.506143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:47.509116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:47.526556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 615/1238] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:47.532177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.651752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddfb51-d645-476d-a92e-e7e7f1b046c3 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:47.695559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:47.696615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.697047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.697463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.701243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:47.708963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:47.712672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:43:47.725594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:47.726602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:47.729070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 624/1239] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:47.733459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:47.848714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56513c98-93d2-4c66-a04d-5029d84fa770 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:47.895997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:47.896785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:47.897144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:47.897547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:47.898406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:47.899305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:47.901392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:47.929402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 616/1240] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:47.937818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:48.064703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cfc20c-7688-4181-95e8-1e8260c1e990 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:48.103629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:48.104247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.104533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.104800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.177845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.186544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:48.187953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:48.309581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 625/1241] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:43:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:43:48.317206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:48.360059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.441069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b286c-c2d5-4ec2-ae3c-218c1fbe50e8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:48.482106 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:48.482830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.483157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.483493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.496753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:48.498203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:48.515390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:48.516589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:48.517857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:48.517857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:48.517857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:48.517857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 617/1242] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:48.523155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:48.641132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.647890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfbea68-0382-4ee9-bb75-08c636ff5e2a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:48.688233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:48.688890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.689166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.689473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.690161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:48.690458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:48.691904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:48.705863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 626/1243] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:48.711806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:48.807687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:48.832896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525565d-92e9-46e8-835f-e9d33b49c693 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:48.871559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:48.872218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:48.872497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:48.872774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:48.880542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:48.881998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:43:48.895385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:48.896643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:48.897808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:48.899909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 618/1244] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:48.903195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:49.025282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd981bd-8e83-47be-b894-10600eab1651 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:49.063013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:49.063667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:49.063947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:49.064219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:49.064912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:49.065211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:49.066665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137427a-0587-4245-832e-f721ef16ea55 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:49.078758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 627/1245] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:49.085026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:49.197023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c067-b39c-4a1d-803a-e5b503003d67 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:49.233558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:49.234154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:49.234427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:49.234694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:49.235401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] RBAC: Adding query filter params (role.id=827566e44d2a49feba52269f4f4e071e, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=f1af6c98265e44eab90317693fb7f1b2) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:49.235730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:49.237128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46123129-23d1-4a23-81dd-0f4252e96106 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:49.242845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 619/1246] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:43:49 2022] GET /identity/v3/role_assignments?user.id=f1af6c98265e44eab90317693fb7f1b2&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=827566e44d2a49feba52269f4f4e071e => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:51.311295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7213e-b503-4228-bf97-cd9c1516245e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.311938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7213e-b503-4228-bf97-cd9c1516245e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.312102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7213e-b503-4228-bf97-cd9c1516245e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.313734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 628/1247] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:51.319343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.319932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.319932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.326633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:51.341282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:51.342539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:51.445524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 620/1248] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:51.741220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7213e-b503-4228-bf97-cd9c1516245e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:51.760591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:51.866006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7213e-b503-4228-bf97-cd9c1516245e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:51.912635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:51.913490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:51.913768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:51.914166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:51.928814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:43:51.935233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:51.936481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:51.937600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 629/1249] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:51.943656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:52.066830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd1398-afc7-4473-a589-8e6f0425b7b2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.100718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:52.106684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.107297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.107726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.107894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.108528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:52.108862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.110182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.119676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 621/1250] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:52.125494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:52.215810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:52.243748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e84345-13e5-47df-8b07-c9733efa7437 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.280084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.280726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.281007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.281279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.292296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.293754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:52.310978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:52.317549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:52.318727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:52.318727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:52.318727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:52.318727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 630/1251] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:52.318993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:52.441364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb85c86-fd9d-4b94-a5d4-c2860ad69b5d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.486961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.487613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.487893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.488220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.488819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:52.489166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.490481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.503945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 622/1252] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:52.510527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:52.635284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa83b17-d061-429f-a5b5-d197822d1ad7 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.665063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:52.674972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.675811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.676091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.676367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.687537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.689299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:43:52.702325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:52.703940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:52.705130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 631/1253] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:43:52.710940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:52.774476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:52.830236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d85500-ed06-475f-9bd1-013b21d10e19 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:52.869945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:52.870562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:52.870944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:52.871350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:52.872346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:52.872677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:52.874096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:52.896461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 623/1254] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:43:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:52.904447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:53.031582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d3cbb-1770-413e-8aea-1c4d7380a36a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:53.069910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:53.071289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.071696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.072059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.135017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:53.148909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:53.150284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:53.269394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 632/1255] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:43:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:43:53.275902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:53.391374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba4b3f-6807-4c19-8378-85dec47f8a73 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:53.411099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:53.438946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:53.439602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.439880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.440154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.452950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:53.454440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:53.470724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:53.472046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:53.472958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:53.472958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:53.472958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:53.472958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 624/1256] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:53.478122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:53.573165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:53.588319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8c79a-1cd6-4f61-a451-f79b4fc81231 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:53.629217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:53.629832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.630141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.630415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.632467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:53.633379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:53.635625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:53.650430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 633/1257] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:53.656737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:53.776227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65667e-1ccb-4721-a7c5-5de61b7d2eb8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:53.814449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:53.815085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:53.815364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:53.815664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:53.823312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:53.825050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:43:53.839227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:53.840847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:43:53.841742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 625/1258] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:53.846608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:53.985205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8927f6-2ad9-451e-88be-392e457fdd3b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:54.029848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:54.030432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:54.030689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:54.030953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:54.031735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:54.032020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:54.033459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726e662f-aff8-4d4f-ae57-6075d280a465 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:54.049301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 634/1259] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:43:54.056424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:54.082684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:54.167102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8174f-7fb0-4c1d-8fe4-c90189b1d497 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:54.205241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:54.205858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:54.206141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:54.206459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:54.207184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=f1af6c98265e44eab90317693fb7f1b2) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:54.207513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:54.209121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98b56a-f21c-4d17-955a-0a9f456ecf47 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:54.215364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 626/1260] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:43:54 2022] GET /identity/v3/role_assignments?user.id=f1af6c98265e44eab90317693fb7f1b2&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:56.137133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce977e-b63b-4880-8974-39b1899bb83e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:56.137661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce977e-b63b-4880-8974-39b1899bb83e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:56.137661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce977e-b63b-4880-8974-39b1899bb83e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:56.139010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 635/1261] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:43:56.144300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:56.144699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:56.144878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:56.163410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:43:56.165269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:43:56.233931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 627/1262] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:43:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:43:56.507842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce977e-b63b-4880-8974-39b1899bb83e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:56.518648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:56.610281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce977e-b63b-4880-8974-39b1899bb83e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:56.643279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:56.643930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:56.644206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:56.644474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:56.655326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:43:56.660016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:56.661103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:56.662044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 636/1263] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:56.668046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:56.686435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:56.766263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94536319-f4eb-42b9-8752-98eec33ccfda None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:56.805495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:56.806104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:56.806382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:56.806658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:56.807325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:56.807661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:56.809026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:56.817535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 628/1264] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:56.823995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:56.892416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:56.929166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82445857-d05b-42ad-aa5e-85ad2f3fe7a8 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:56.969136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:56.969888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:56.970306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:56.970536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:56.981430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:56.982866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:56.997791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:56.998983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:56.999937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:56.999937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:56.999937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:56.999937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 637/1265] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:57.004906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.088019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.107229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49994478-1c41-4953-9511-d4fe41cad330 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.140904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.141535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.141937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.142212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.142879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:57.143200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.144758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.157761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 629/1266] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:57.163642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.265420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9b88-7f8f-4951-9bec-3b53437df9e0 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.285072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.300253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.300875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.301155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.301431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.308939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.310640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:43:57.321643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:57.322756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:43:57.323984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:57.327583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 638/1267] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:57.328680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.430835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dacf36-e483-4165-8724-71106d3e851f None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.469015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.469613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.469889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.470156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.470934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:57.471234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.472697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.481709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.491193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 630/1268] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:57.497040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.599913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9202f8e2-8f56-431e-b17f-2a5c0013c9ba None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.635412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.636133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.636404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.636675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.647352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.648869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:43:57.662664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:57.664369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:43:57.665285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:43:57.665285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:43:57.665285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:57.665285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 639/1269] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:57.670383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.777012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157836-8434-4ead-8a7b-ecf0619ee826 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.811530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.812270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.812601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.812871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.813509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:57.813802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.815163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:57.827096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 631/1270] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:57.832834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:57.870922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:57.947795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a32f40-6b92-46ad-9c10-39ad4ffcc78b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:57.981483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:57.982102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:57.982378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:57.982646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:57.989201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:57.990617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:43:58.002878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:43:58.003953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:43:58.004963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 640/1271] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:43:58.010687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:58.071575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:58.111964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da53156-0fe2-4d1a-a090-ddc9e4d725ad None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:58.145301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:58.145920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:58.146155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:58.146426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:58.147115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:43:58.147406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:58.149017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95319885-0ea4-4021-86ff-a70543cba7b7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:58.161208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 632/1272] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:43:58.167783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:43:58.257949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:43:58.267069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25df04-c873-4d71-8c0c-1220637ce98c None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:43:58.300292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:43:58.300941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:43:58.301215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:43:58.301485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] PATH_INFO: `/v3/projects/9f70d413dd75492aac987cc32f144d52/users/f1af6c98265e44eab90317693fb7f1b2/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:43:58.303346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9f70d413dd75492aac987cc32f144d52, user_id=f1af6c98265e44eab90317693fb7f1b2, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:43:58.305400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929615d6-50f8-4346-bc5f-9b3b1789ede9 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:43:58.318296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 641/1273] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Aug 24 04:43:58 2022] PUT /identity/v3/projects/9f70d413dd75492aac987cc32f144d52/users/f1af6c98265e44eab90317693fb7f1b2/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:44:00.240248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33111-cdec-424e-a851-8ac56b27fca5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:00.240811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33111-cdec-424e-a851-8ac56b27fca5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:00.240811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f33111-cdec-424e-a851-8ac56b27fca5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.242138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 633/1274] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:00.247613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:00.248022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:00.248155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.266090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:00.267267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:00.336037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 642/1275] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:44:00.604412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33111-cdec-424e-a851-8ac56b27fca5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:00.705607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f33111-cdec-424e-a851-8ac56b27fca5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:00.723992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:00.741001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:00.741628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:00.741927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:00.742200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.752254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 04:44:00.756923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:00.758603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:00.759527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 634/1276] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Aug 24 04:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:00.764711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:00.845943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:00.864937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff7c82-bb1b-49f4-b242-e6f3ea86bf10 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:00.902309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:00.902982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:00.903448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:00.903869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:00.904590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:00.904958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:00.906820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:00.917339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 643/1277] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Aug 24 04:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:00.923609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.044666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5da06-dcd6-4c90-903c-2159644d74db None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:01.080194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:01.080821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:01.081094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:01.081361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:01.092668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:01.094105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:44:01.108803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:01.110084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:44:01.111538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:44:01.111538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:44:01.111538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:01.111538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 635/1278] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:01.116109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.215913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893caefe-32b1-4d01-bea9-73d0c770cc3d None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:01.252542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:01.253769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:01.253769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:01.253769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:01.254276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:01.254571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:01.255958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:01.267908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 644/1279] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:01.273947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.306224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:01.378047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02925026-e345-44db-861c-2ea4477e5fcd None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:01.410471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:01.411074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:01.411342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:01.411637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:01.419684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:01.421108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 04:44:01.432628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:01.433753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:01.435175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 636/1280] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:44:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:01.439828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.443735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:01.541221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7a198-20e2-4db1-9d60-f326d64c987b None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:01.575445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:01.576074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:01.576353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:01.576623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:01.577340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:01.577636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:01.579049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:01.596473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 645/1281] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Aug 24 04:44:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:01.602508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.692168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:01.702550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37893be-45cc-47d1-9979-88e678447abb None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:01.734427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:01.735011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:01.735283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:01.735576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:01.801686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:01.803131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:01.897302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:01.908995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 637/1282] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Aug 24 04:44:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 04:44:01.916240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:01.980034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:02.020611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb89939-b8a7-4c11-a280-9f0d26d91c0f None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:02.054040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:02.055203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:02.055503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:02.055782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:02.065908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:02.067344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 04:44:02.081940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:02.083086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 04:44:02.084016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 04:44:02.084016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 04:44:02.084016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:44:02.084016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 646/1283] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:02.089049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:02.193970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a1c0ce-49fb-4a31-85b3-d87bb519e465 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:02.228421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:02.229028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:02.229306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:02.229576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:02.230268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:02.230517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:02.231968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:02.244182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 638/1284] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Aug 24 04:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:02.250046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:02.352121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2c592-824e-4d83-a7a3-1393f81742ab None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:02.365521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:02.385568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:02.386192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:02.386469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:02.386738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:02.393265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:02.394682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 04:44:02.406207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:02.407232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: ERROR keystone.server.flask.application Aug 24 04:44:02.408332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 647/1285] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Aug 24 04:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 04:44:02.413282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:02.465180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:02.515313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f9cd3-95b9-49f1-8c5f-2c85e5f2dcd1 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:02.549223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:02.549817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:02.550096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:02.550371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:02.551053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:02.551356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:02.552812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc378e8-f88d-4d69-a460-01427e839d45 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:02.564769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 639/1286] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Aug 24 04:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:02.571240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:02.670650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c40e2-edd0-4b9b-8b57-78bd305ad710 None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:02.704019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:02.704613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:02.704894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:02.705169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:02.705888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] RBAC: Adding query filter params (role.id=1322cdb780e0414da6e3fc27dcbaecf8, scope.project.id=9f70d413dd75492aac987cc32f144d52, user.id=f1af6c98265e44eab90317693fb7f1b2) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:02.706190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:02.707638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f7eeb-eb57-4e67-ab36-ec0e2a61aaac None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:02.713919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 648/1287] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Aug 24 04:44:02 2022] GET /identity/v3/role_assignments?user.id=f1af6c98265e44eab90317693fb7f1b2&scope.project.id=9f70d413dd75492aac987cc32f144d52&role.id=1322cdb780e0414da6e3fc27dcbaecf8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:04.787695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555df08-03f7-48c6-83af-057f0986b937 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:04.788246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555df08-03f7-48c6-83af-057f0986b937 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:04.788246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555df08-03f7-48c6-83af-057f0986b937 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:04.789607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 640/1288] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:04.795829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:04.796323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:04.796416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:04.815046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:04.816287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:04.846374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:04.884441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 649/1289] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:44:05.167876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555df08-03f7-48c6-83af-057f0986b937 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:05.269146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555df08-03f7-48c6-83af-057f0986b937 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:05.279725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:05.303343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:05.304586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:05.304975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:05.305251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:05.305828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:05.307174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:05.315935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:05.319793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:05.320891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 641/1290] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:44:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:05.323193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:05.422628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81bf629-41e2-4f99-8899-78d872220107 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:05.456619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:05.457223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:05.457499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:05.457767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:05.458397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:05.458697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:05.460099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ea851-76f3-4873-9776-e9d9bdd9fc66 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:05.465641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 650/1291] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Aug 24 04:44:05 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:05.471523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:05.571847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3aa346-ccee-4fff-9502-4e064dd65d7d None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:05.605585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb226142-7422-4808-a994-a97848084983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:05.606178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226142-7422-4808-a994-a97848084983 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:05.606454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226142-7422-4808-a994-a97848084983 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:05.606723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb226142-7422-4808-a994-a97848084983 None admin] PATH_INFO: `/v3/services` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:05.607357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb226142-7422-4808-a994-a97848084983 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:05.607683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb226142-7422-4808-a994-a97848084983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:05.609038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb226142-7422-4808-a994-a97848084983 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:05.613554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 642/1292] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Aug 24 04:44:05 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:07.528682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1e5f-6267-4814-96de-884dcd084ab1 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:07.529206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1e5f-6267-4814-96de-884dcd084ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:07.529206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb1e5f-6267-4814-96de-884dcd084ab1 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:07.530586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 651/1293] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:07.535967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4637-fd7b-4da4-9216-f0c10f7a650f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:07.536405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4637-fd7b-4da4-9216-f0c10f7a650f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:07.536523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d4637-fd7b-4da4-9216-f0c10f7a650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:07.555655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-179d4637-fd7b-4da4-9216-f0c10f7a650f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:07.556846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-179d4637-fd7b-4da4-9216-f0c10f7a650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:07.586976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:07.626184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 643/1294] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:44:07.906819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1e5f-6267-4814-96de-884dcd084ab1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:07.943497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:08.037318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb1e5f-6267-4814-96de-884dcd084ab1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:08.074614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:08.075313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:08.075624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:08.075899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:08.076857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:08.078753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb979039-cffb-4295-a50e-2567be437ad1 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:08.100047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 652/1295] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Aug 24 04:44:07 2022] POST /identity/v3/services => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:44:10.034250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0cff-d7ea-4691-be1d-c0d402eca0a9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:10.034818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0cff-d7ea-4691-be1d-c0d402eca0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:10.034818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb0cff-d7ea-4691-be1d-c0d402eca0a9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:10.036170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 644/1296] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:10.042264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:10.042686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:10.042817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:10.061085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:10.062276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:10.135310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 653/1297] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:44:10.405252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0cff-d7ea-4691-be1d-c0d402eca0a9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:10.506019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddb0cff-d7ea-4691-be1d-c0d402eca0a9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:10.541514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:10.542124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:10.542403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:10.542678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:10.543251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:10.544644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:10.553225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:10.554935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:10.555932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 645/1298] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:44:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:10.561279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:10.579975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:10.660432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377c868-d77a-450c-b1a5-c78b545c108c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:10.694245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:10.695457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:10.695769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:10.696041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:10.696669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:10.696969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:10.698353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:10.703374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 654/1299] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Aug 24 04:44:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:10.709462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:10.740563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:10.809863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d9c1e-f164-4e69-a4e8-c70c702fffa8 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:10.843150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:10.843773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:10.844052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:10.844323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:10.845017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] RBAC: Adding query filter params (interface=public, service_id=8c32304bf1ca469fb6e7a55febded9e1, region_id=RegionOne) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:10.845320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:10.846666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49687af6-66d5-47f0-bb2d-cdffe7f91cd7 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:10.851921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 646/1300] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Aug 24 04:44:10 2022] GET /identity/v3/endpoints?service_id=8c32304bf1ca469fb6e7a55febded9e1&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:10.857789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:10.951853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:10.971385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f746c9-caf1-4b46-a55b-fcf38cbbca1a None admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:11.006277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:11.007449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:11.007763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:11.008109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:11.008712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:11.010075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b669e-3a7a-4cb9-a4e5-202c17a42275 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:11.016711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 655/1301] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Aug 24 04:44:10 2022] GET /identity/v3/services => generated 2191 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:44:12.933654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28043-9b2b-4722-b492-cbb840cc91d8 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.934456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28043-9b2b-4722-b492-cbb840cc91d8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.934456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28043-9b2b-4722-b492-cbb840cc91d8 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.935864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 647/1302] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:44:12.941030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:12.941407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:12.941571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:12.960554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:44:12.961727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:44:13.027025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 656/1303] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:44:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 04:44:13.299400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28043-9b2b-4722-b492-cbb840cc91d8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:13.394646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:13.402378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28043-9b2b-4722-b492-cbb840cc91d8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:13.436574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:13.437186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:13.437463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:13.437732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:13.438298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:13.439796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 04:44:13.449144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 04:44:13.450354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application with Lock( Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self._enter() Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application return self.creator() Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application created_value = creator( Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: ERROR keystone.server.flask.application Aug 24 04:44:13.451390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 648/1304] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Aug 24 04:44:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 04:44:13.456583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:13.532825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:13.556319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be83b-ccf7-4628-9df3-33d096e8ca31 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:13.592675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:13.593263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:13.593536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:13.593802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] PATH_INFO: `/v3/services` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:13.594419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:44:13.594713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:13.596098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19939dec-e3c6-4474-8325-097b5fd4a920 None admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:13.601372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 657/1305] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Aug 24 04:44:13 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:44:13.607290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:44:13.706240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0831b-ff1c-4693-8381-fbdce6094cd3 None admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:44:13.738954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:44:13.739602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:44:13.739876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:44:13.740150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:44:13.740814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:44:13.742890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b3249c-cdea-43af-a1e8-b401191fadfd None admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:44:13.762702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 649/1306] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:44:13 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:44:23.598118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=30 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:44:23.758465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:19.601067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9710-5b3b-4944-8b7b-e0e5e950fcaf None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:19.601542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9710-5b3b-4944-8b7b-e0e5e950fcaf None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:19.601623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4b9710-5b3b-4944-8b7b-e0e5e950fcaf None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:19.608398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971563-250f-415a-a78c-e2dac1c4d4dc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:19.608812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971563-250f-415a-a78c-e2dac1c4d4dc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:19.609011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a971563-250f-415a-a78c-e2dac1c4d4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:19.611865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 658/1307] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:19.700116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9a971563-250f-415a-a78c-e2dac1c4d4dc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:19.701350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9a971563-250f-415a-a78c-e2dac1c4d4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:19.835510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 650/1308] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:45:20.141964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:20.142419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:20.142681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:20.143966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 659/1309] 10.222.0.85 () {54 vars in 965 bytes} [Wed Aug 24 04:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:20.152249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416806a-4a94-41df-a43c-33fa243317f7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:20.152603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416806a-4a94-41df-a43c-33fa243317f7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:20.152865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416806a-4a94-41df-a43c-33fa243317f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:20.246400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b416806a-4a94-41df-a43c-33fa243317f7 None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:20.247692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b416806a-4a94-41df-a43c-33fa243317f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:20.272080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:20.340123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 651/1310] 10.222.0.85 () {58 vars in 1062 bytes} [Wed Aug 24 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:20.350457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:20.352304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:20.473247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b687a-a2d7-4417-94f7-3c7deaf06383 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:20.554514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:20.554514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:20.554514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:20.554884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:20.556347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:20.616846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:20.682430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:20.684155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56103f9-5aa4-4e7d-9185-74f6c6257a29 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:20.704071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 660/1311] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:22.959054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:22.959495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:22.959600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:22.960950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 652/1312] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:22.966398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc7e5-b3cd-4768-9b48-296612eb6ef6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:22.966917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc7e5-b3cd-4768-9b48-296612eb6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:22.966917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edc7e5-b3cd-4768-9b48-296612eb6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:23.040427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-91edc7e5-b3cd-4768-9b48-296612eb6ef6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:23.041541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-91edc7e5-b3cd-4768-9b48-296612eb6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:23.141842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 661/1313] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:23.427286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:23.428834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:23.540033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9faa7-6830-46a1-be82-702a1dce5c1e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:23.614388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:23.617003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:23.617799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:23.618232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:23.618515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:23.620511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:23.735161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:23.736653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd4490-8b9e-4df4-85af-71811b8efa0d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:23.757295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 653/1314] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:26.007875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:26.008451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:26.008451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:26.009739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 662/1315] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:26.015642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0de-91dc-46c9-aa49-943da5699c72 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:26.016484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0de-91dc-46c9-aa49-943da5699c72 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:26.016766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff0de-91dc-46c9-aa49-943da5699c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:26.087943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-065ff0de-91dc-46c9-aa49-943da5699c72 None None] MFA Rules not processed for user `0eb94d3a0da1487c9b4748256681e307`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:26.089175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-065ff0de-91dc-46c9-aa49-943da5699c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:26.143330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:26.189007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 654/1316] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:26.477997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:26.479582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:26.490030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:26.584724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df093a36-9244-4b5d-bebc-60e7ae688931 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:26.658720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:26.659876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:26.660152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:26.660424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:26.662057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:26.729653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:26.776968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:26.778372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a8ebf-c04f-4074-8507-cb51027641e0 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:26.797601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 663/1317] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:26 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:29.280594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:29.281142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:29.281142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:29.282536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 655/1318] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:29.287985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbba62-dbb8-482c-9229-36d2e6f06e8f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:29.288434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbba62-dbb8-482c-9229-36d2e6f06e8f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:29.288531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbba62-dbb8-482c-9229-36d2e6f06e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:29.356000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-abcbba62-dbb8-482c-9229-36d2e6f06e8f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:29.357238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-abcbba62-dbb8-482c-9229-36d2e6f06e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:29.454552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 664/1319] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:45:29.739222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:29.740892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:29.844470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112594-2823-409b-8d3c-4a62063ee299 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:29.920523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:29.921122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:29.921397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:29.921663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:29.923270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:29.930934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:30.033472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:30.034946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823ec70-fb95-4f1f-ae1e-1b3076130063 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:30.054842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 656/1320] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:32.657064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:32.657619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:32.657619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:32.659519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 665/1321] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:32.664942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a754-3775-4cc4-9b01-3b492567d69c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:32.665375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a754-3775-4cc4-9b01-3b492567d69c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:32.665652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156a754-3775-4cc4-9b01-3b492567d69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:32.739617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2156a754-3775-4cc4-9b01-3b492567d69c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:32.740775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2156a754-3775-4cc4-9b01-3b492567d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:32.800095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:32.841516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 657/1322] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:33.128781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:33.130420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:33.151982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:33.241019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912eef8d-56c9-44f8-aca0-01f2b06f9d56 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:33.317107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:33.317702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:33.317972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:33.318233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:33.319853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:33.391643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:33.430768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:33.432485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6894e0b-07fd-4f66-999e-747841ec85e0 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:33.453526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 666/1323] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:35.458732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:35.459235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:35.459235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:35.460650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 658/1324] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:35.466280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fd7e-1e68-4177-87b2-da47d8159715 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:35.466695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fd7e-1e68-4177-87b2-da47d8159715 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:35.466814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8fd7e-1e68-4177-87b2-da47d8159715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:35.538548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-86a8fd7e-1e68-4177-87b2-da47d8159715 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:35.539808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-86a8fd7e-1e68-4177-87b2-da47d8159715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:35.639371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 667/1325] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:35.929834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:35.931401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:36.039265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8248-a8c9-4444-9aac-518c8cf70f34 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:36.116032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:36.116638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:36.116918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:36.117193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:36.118796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:36.136552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:36.236690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:36.238110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9db98f-7533-427e-9921-6fc6eb56e35c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:36.256192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 659/1326] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:38.245075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617a2-602b-436c-ab2c-8384228aab5e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:38.245621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617a2-602b-436c-ab2c-8384228aab5e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:38.245621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231617a2-602b-436c-ab2c-8384228aab5e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:38.247004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 668/1327] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:38.252836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741340f-a19f-4484-943d-88def95d8017 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:38.253372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741340f-a19f-4484-943d-88def95d8017 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:38.253372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741340f-a19f-4484-943d-88def95d8017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:38.325542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7741340f-a19f-4484-943d-88def95d8017 None None] MFA Rules not processed for user `0eb94d3a0da1487c9b4748256681e307`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:38.327044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7741340f-a19f-4484-943d-88def95d8017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:38.393458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:38.428619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 660/1328] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:38.730761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:38.731039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:38.731321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:38.732731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 669/1329] 10.222.0.85 () {54 vars in 965 bytes} [Wed Aug 24 04:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:38.740072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d9999-6be9-4c55-8be0-ca95fa5a3a66 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:38.740366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d9999-6be9-4c55-8be0-ca95fa5a3a66 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:38.740730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d9999-6be9-4c55-8be0-ca95fa5a3a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:38.825053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-395d9999-6be9-4c55-8be0-ca95fa5a3a66 None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:38.826278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-395d9999-6be9-4c55-8be0-ca95fa5a3a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:38.902973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 661/1330] 10.222.0.85 () {58 vars in 1062 bytes} [Wed Aug 24 04:45:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:38.912908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:38.914529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:38.947648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:39.028183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e646ae-9822-48a6-a8c0-04ed95d38630 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:39.108442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:39.109072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:39.109347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:39.109615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:39.111222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:39.193735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:39.229481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:39.231240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6baa0-f39d-46cd-9951-10bba42d7b97 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:39.253223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 670/1331] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:41.827775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.828336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.828534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.829717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 662/1332] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:41.835678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5790-be21-46a1-a16f-48cedd1d0828 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:41.836069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5790-be21-46a1-a16f-48cedd1d0828 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:41.836228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c5790-be21-46a1-a16f-48cedd1d0828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:41.902990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ad6c5790-be21-46a1-a16f-48cedd1d0828 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:41.904244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ad6c5790-be21-46a1-a16f-48cedd1d0828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.002757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 671/1333] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:42.288007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:42.289545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.361120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:42.397465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b092295-f605-4a29-902f-022bf34fbf4c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:42.471562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:42.472245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:42.472519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:42.472814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:42.474404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:42.584892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:42.586211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6338628-b883-4d16-b668-c67bb502ae28 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:42.596958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:42.605899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 663/1334] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:44.586707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f179-2a61-469d-be85-883b71316d0c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:44.587258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f179-2a61-469d-be85-883b71316d0c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:44.587258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989f179-2a61-469d-be85-883b71316d0c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:44.588615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 672/1335] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:45:44.593801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96a87-aa5f-401b-b698-8d70a3972a26 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:44.594181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96a87-aa5f-401b-b698-8d70a3972a26 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:44.594355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96a87-aa5f-401b-b698-8d70a3972a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:44.662575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2ab96a87-aa5f-401b-b698-8d70a3972a26 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:44.663851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2ab96a87-aa5f-401b-b698-8d70a3972a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:44.759517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 664/1336] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:45.051438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f179-2a61-469d-be85-883b71316d0c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:45.053098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d989f179-2a61-469d-be85-883b71316d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:45.095439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:45.162050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989f179-2a61-469d-be85-883b71316d0c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:45.238035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:45.238640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:45.238916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:45.239185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:45.240823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:45.324491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:45.350711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:45.352186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9236988e-eb81-4041-96f1-30ee10f1b5e8 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:45.370988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 673/1337] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:47.749093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:47.749600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:47.749600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:47.750889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 665/1338] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:47.756574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03ab4-b49f-42f9-97eb-114f23397cf6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:47.757046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03ab4-b49f-42f9-97eb-114f23397cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:47.757155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd03ab4-b49f-42f9-97eb-114f23397cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:47.825575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fdd03ab4-b49f-42f9-97eb-114f23397cf6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:47.826816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fdd03ab4-b49f-42f9-97eb-114f23397cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:47.930510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 674/1339] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:48.214412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:48.215990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:48.292266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:48.322011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91213955-236c-4c5e-b69c-82fea7bd4ee9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:48.397405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:48.398014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:48.398292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:48.398562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:48.400200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:48.514792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:48.516269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd2cce-1ff8-4b2b-9482-f4bee889a49c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:48.534979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 666/1340] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:52.533218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:52.533844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:52.533844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:52.535093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 675/1341] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:52.540514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980c8a-da9f-4f63-8e15-4e0d93f2e2a7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:52.540976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980c8a-da9f-4f63-8e15-4e0d93f2e2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:52.541104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f980c8a-da9f-4f63-8e15-4e0d93f2e2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:52.546670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:52.610457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2f980c8a-da9f-4f63-8e15-4e0d93f2e2a7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:52.612238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f980c8a-da9f-4f63-8e15-4e0d93f2e2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:52.712187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 667/1342] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:53.006690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:53.008294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:53.057797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:53.116799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677d2bd-bf97-43a7-b971-12845dbf86d6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:53.193165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:53.193784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:53.194064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:53.194337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:53.196019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:53.295314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:53.312952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:53.314478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8540d5-36bf-48c3-800f-24864b908f78 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:53.333115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 676/1343] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:45:55.896933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:55.897561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:55.897561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:55.899189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 668/1344] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:45:55.905679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f67e1-574b-474c-b2d2-50c72dd978bb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:55.906247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f67e1-574b-474c-b2d2-50c72dd978bb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:55.906352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f67e1-574b-474c-b2d2-50c72dd978bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:55.975451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-504f67e1-574b-474c-b2d2-50c72dd978bb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:45:55.976690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-504f67e1-574b-474c-b2d2-50c72dd978bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:56.074698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 677/1345] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:45:56.361415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:45:56.362978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:56.455190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:45:56.473342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf84b80-83ee-4b3a-a85d-e7919dc54ae7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:45:56.553540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:45:56.554160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:45:56.554431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:45:56.554697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:45:56.556475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:45:56.680309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:45:56.681908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd7d057-17fa-46e4-bace-fc80758f2e1a service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:45:56.701074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 669/1346] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:00.689054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:00.689894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:00.690169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:00.691726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 678/1347] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:00.697097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3df1-c9ff-454f-a895-85e0c5ee9df6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:00.698919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3df1-c9ff-454f-a895-85e0c5ee9df6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:00.698919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd3df1-c9ff-454f-a895-85e0c5ee9df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:00.717639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:00.783036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9fcd3df1-c9ff-454f-a895-85e0c5ee9df6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:00.785040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9fcd3df1-c9ff-454f-a895-85e0c5ee9df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:00.898365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 670/1348] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:46:01.194241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:01.195832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:01.270828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:01.326035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95b901-2a16-43d8-9a0e-dbca53645305 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:01.437229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:01.438018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:01.438982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:01.439394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:01.441338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:01.568185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:01.572767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:01.574207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f14557-9d11-4125-9348-4f3d2b58cb72 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:01.595286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 679/1349] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:06.745883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f4cdb-5006-433a-a8fe-27a82e24e7fc None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.746348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f4cdb-5006-433a-a8fe-27a82e24e7fc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.746348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f4cdb-5006-433a-a8fe-27a82e24e7fc None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.747739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 671/1350] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:06.756585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3075a1a-ab62-4b02-a109-dd89b52b0c4b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:06.758162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3075a1a-ab62-4b02-a109-dd89b52b0c4b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:06.758833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3075a1a-ab62-4b02-a109-dd89b52b0c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:06.887236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a3075a1a-ab62-4b02-a109-dd89b52b0c4b None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:06.889048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a3075a1a-ab62-4b02-a109-dd89b52b0c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:07.085356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 680/1351] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:10.896353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=59 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:11.417509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1668d-378e-4af2-8dfe-3e5b6892cfb9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:11.417905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1668d-378e-4af2-8dfe-3e5b6892cfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:11.418104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd1668d-378e-4af2-8dfe-3e5b6892cfb9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:11.419655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 672/1352] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:46:11.425443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e67f-fdf8-4258-b32b-9d86298e8dab None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:11.425982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e67f-fdf8-4258-b32b-9d86298e8dab None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:11.425982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0e67f-fdf8-4258-b32b-9d86298e8dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:11.511579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:11.550851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ece0e67f-fdf8-4258-b32b-9d86298e8dab None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:11.552102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ece0e67f-fdf8-4258-b32b-9d86298e8dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:11.692763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 681/1353] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:46:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:46:13.086719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd29b8-db75-4a96-90ee-ba1aa6851cd9 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:13.087258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd29b8-db75-4a96-90ee-ba1aa6851cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:13.087258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd29b8-db75-4a96-90ee-ba1aa6851cd9 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:13.089322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 673/1354] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:13.096857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f007f-b93c-4907-86f6-886ab06f9c2f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:13.097346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f007f-b93c-4907-86f6-886ab06f9c2f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:13.097557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f007f-b93c-4907-86f6-886ab06f9c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:13.178579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-9a6f007f-b93c-4907-86f6-886ab06f9c2f None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:13.179828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9a6f007f-b93c-4907-86f6-886ab06f9c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:13.228995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:13.302908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 682/1355] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:46:16.676586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2946-d191-4de6-b1a0-7bbfbd35cf2a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:16.677087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2946-d191-4de6-b1a0-7bbfbd35cf2a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:16.677087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a2946-d191-4de6-b1a0-7bbfbd35cf2a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:16.678624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 674/1356] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:16.684519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a871-c33b-410e-bf07-70cb64c44925 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:16.685043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a871-c33b-410e-bf07-70cb64c44925 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:16.685213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93a871-c33b-410e-bf07-70cb64c44925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:16.764159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2b93a871-c33b-410e-bf07-70cb64c44925 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:16.765388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2b93a871-c33b-410e-bf07-70cb64c44925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:16.882220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 683/1357] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:17.205023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:17.206345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:17.210519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:17.212266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 675/1358] 10.222.0.85 () {54 vars in 962 bytes} [Wed Aug 24 04:46:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:17.229394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f50e0-8731-4c29-8d9b-68427a177e74 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:17.230058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f50e0-8731-4c29-8d9b-68427a177e74 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:17.231895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f50e0-8731-4c29-8d9b-68427a177e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:17.256094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:17.338958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a40f50e0-8731-4c29-8d9b-68427a177e74 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:17.340481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a40f50e0-8731-4c29-8d9b-68427a177e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:17.484281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 684/1359] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Aug 24 04:46:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:17.495617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:17.497479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:17.654472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c82bba-4180-41ce-adf7-0af3f0b5df99 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:17.739123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:17.782555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:17.783183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:17.783463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:17.783765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:17.785401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:17.885528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:17.887122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76494a8-0a01-40c8-aebe-2bbd5b27f2b9 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:17.908543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 676/1360] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:20.085142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:20.085785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:20.085785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:20.087052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 685/1361] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:20.092874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b3d0-c664-4620-9084-cc2401c58aaf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:20.093363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b3d0-c664-4620-9084-cc2401c58aaf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:20.093476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8b3d0-c664-4620-9084-cc2401c58aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:20.167249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-95e8b3d0-c664-4620-9084-cc2401c58aaf None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:20.168864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-95e8b3d0-c664-4620-9084-cc2401c58aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:20.214838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:20.288331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 677/1362] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:20.586827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:20.588317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:20.665514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:20.757511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868980b-2ea9-4478-a059-b6aff4efa579 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:20.884756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:20.885368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:20.885642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:20.885911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:20.887697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:20.916180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:20.997997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:20.999631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd5db6a-599e-48e8-af91-b875b36e6b8c service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:21.021493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 686/1363] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:23.318211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e3b3-304c-4617-a4d0-60c963a45e28 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:23.318775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e3b3-304c-4617-a4d0-60c963a45e28 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:23.318775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e3b3-304c-4617-a4d0-60c963a45e28 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:23.320146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 678/1364] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:23.325678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14974-62a8-40ad-92da-31f90dfceb8c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:23.326126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14974-62a8-40ad-92da-31f90dfceb8c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:23.326207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a14974-62a8-40ad-92da-31f90dfceb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:23.400536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-40a14974-62a8-40ad-92da-31f90dfceb8c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:23.402102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-40a14974-62a8-40ad-92da-31f90dfceb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:23.519147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:23.527456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 687/1365] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:23.815114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:23.815396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:23.815912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:23.817316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 679/1366] 10.222.0.85 () {54 vars in 962 bytes} [Wed Aug 24 04:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:23.822812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28fb3-5245-451c-b721-e56c58968b49 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:23.823101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28fb3-5245-451c-b721-e56c58968b49 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:23.823377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae28fb3-5245-451c-b721-e56c58968b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:23.908043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6ae28fb3-5245-451c-b721-e56c58968b49 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:23.909196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6ae28fb3-5245-451c-b721-e56c58968b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:24.039757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 688/1367] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Aug 24 04:46:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:24.048119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:24.049648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:24.210984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d25732f-f7e2-49ea-81c0-2e2c271f230d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:24.232768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:24.335399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:24.336080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:24.336363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:24.336557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:24.338207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:24.435665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:24.438389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92296f3e-57d7-4191-b97a-ee3eaf4042f6 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:24.460646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 680/1368] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:25.041985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db007-97a4-47eb-8ce7-b96ffbaa6493 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:25.042576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db007-97a4-47eb-8ce7-b96ffbaa6493 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:25.042576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db007-97a4-47eb-8ce7-b96ffbaa6493 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:25.044091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 689/1369] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:46:25.050309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670c3-1381-444d-bc11-b6a4dbbd428b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:25.050597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670c3-1381-444d-bc11-b6a4dbbd428b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:25.050876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202670c3-1381-444d-bc11-b6a4dbbd428b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:25.085441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:25.123996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-202670c3-1381-444d-bc11-b6a4dbbd428b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:25.126088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-202670c3-1381-444d-bc11-b6a4dbbd428b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:25.233275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 681/1370] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:46:25.825015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:25.825015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:25.825015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:25.825590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 690/1371] 10.222.0.85 () {54 vars in 964 bytes} [Wed Aug 24 04:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:25.830796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d564b-5208-4e73-8a3f-774eba3e4c97 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:25.831292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d564b-5208-4e73-8a3f-774eba3e4c97 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:25.831685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d564b-5208-4e73-8a3f-774eba3e4c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:25.918214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fa3d564b-5208-4e73-8a3f-774eba3e4c97 None None] MFA Rules not processed for user `35b6d6e1beae43fab3e5b1a32447540c`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:25.919426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fa3d564b-5208-4e73-8a3f-774eba3e4c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:25.969832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:26.002674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 682/1372] 10.222.0.85 () {58 vars in 1061 bytes} [Wed Aug 24 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:26.010632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:26.012181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:26.066691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:26.124276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a83c68-5296-4dc9-84ed-39479f6c2e56 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:26.206171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:26.206730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:26.207011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:26.207272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:26.208980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:26.334108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:26.350149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:26.351725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fc3bf5-ebcd-4dde-9bee-33a7d9804251 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:26.384113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 691/1373] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:26.487383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:26.487704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:26.487986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:26.489632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 683/1374] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:26.501376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eab3-03eb-4202-9c90-b07ad5198d97 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:26.501667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eab3-03eb-4202-9c90-b07ad5198d97 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:26.501939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35eab3-03eb-4202-9c90-b07ad5198d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:26.585498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7a35eab3-03eb-4202-9c90-b07ad5198d97 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:26.586647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7a35eab3-03eb-4202-9c90-b07ad5198d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:26.691301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 692/1375] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:26.988043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:26.989586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:27.144888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b423d-0c41-4db1-a93c-ae8ec25ba049 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:27.196740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:27.266918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:27.267570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:27.267856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:27.268127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:27.269711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:27.365886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:27.367462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177e378-dc9c-4d21-a428-4e8eee4ac499 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:27.385773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 684/1376] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:29.370129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:29.370672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:29.370672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:29.372231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 693/1377] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:29.377588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530f49-7e48-4dda-b60f-e5854518925a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:29.377995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530f49-7e48-4dda-b60f-e5854518925a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:29.378138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d530f49-7e48-4dda-b60f-e5854518925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:29.466404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0d530f49-7e48-4dda-b60f-e5854518925a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:29.467884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0d530f49-7e48-4dda-b60f-e5854518925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:29.476916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:29.587847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 685/1378] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:29.886496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:29.888088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:29.984920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:30.101509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fcaf06-f3a0-43ac-8c1a-b492d02b21bc None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:30.231687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:30.232225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:30.232501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:30.232774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:30.234753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:30.255526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:30.340624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:30.342401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accdb0a8-798c-4532-acb5-9a10781c61c8 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:30.365652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 694/1379] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:32.360042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:32.360492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:32.360806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:32.368244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156f98-96a9-4208-b0fc-1cad9f43104e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:32.368244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156f98-96a9-4208-b0fc-1cad9f43104e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:32.368789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65156f98-96a9-4208-b0fc-1cad9f43104e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:32.373495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 686/1380] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:32 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:32.480323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-65156f98-96a9-4208-b0fc-1cad9f43104e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:32.484288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-65156f98-96a9-4208-b0fc-1cad9f43104e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:32.582638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:32.589502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 695/1381] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:32.891553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:32.893194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:33.054834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:33.067241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904eaf66-869f-40b2-b717-298ed5b4d929 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:33.195823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:33.196347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:33.196628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:33.196901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:33.198512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:33.300869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:33.302467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeabcded-76db-4e65-a93c-5e953f2074a1 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:33.314644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:33.324987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 687/1382] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:35.463276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:35.464116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:35.464116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:35.465124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 696/1383] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:35.470765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdccca3-1295-494c-a7fe-aec200f90b6e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:35.471540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdccca3-1295-494c-a7fe-aec200f90b6e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:35.471540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdccca3-1295-494c-a7fe-aec200f90b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:35.549048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0fdccca3-1295-494c-a7fe-aec200f90b6e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:35.550292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0fdccca3-1295-494c-a7fe-aec200f90b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:35.656954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 688/1384] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:35.946134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:35.949536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:36.127237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6da8e3-c1b9-4fa9-a237-a292f40257ce None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:36.200413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:36.265482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:36.266269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:36.266643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:36.267054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:36.269235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:36.408303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:36.410747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3419601-bf35-4f11-b69e-2dbf483ac5ae service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:36.432710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 697/1385] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:38.381822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:38.382437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:38.382437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:38.383763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 689/1386] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:38.390076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e9be-7f8c-4cf1-99cf-f571418cd479 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:38.390552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e9be-7f8c-4cf1-99cf-f571418cd479 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:38.390871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0e9be-7f8c-4cf1-99cf-f571418cd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:38.468517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-92f0e9be-7f8c-4cf1-99cf-f571418cd479 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:38.469776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-92f0e9be-7f8c-4cf1-99cf-f571418cd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:38.517622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:38.591580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 698/1387] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:38.888393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:38.889938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:38.977622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:39.068831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb3cdc7-4fac-4d09-be71-f21cfadc2408 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:39.213441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:39.214437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:39.214785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:39.215121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:39.217213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:39.263989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:39.325332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:39.327641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d962206-1c76-4724-a4da-2d9ea3a4032b service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:39.348372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 690/1388] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:41.319374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83d1f-0bf4-4c06-8b9c-b31678a598c9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:41.320028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83d1f-0bf4-4c06-8b9c-b31678a598c9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:41.320028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed83d1f-0bf4-4c06-8b9c-b31678a598c9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:41.321380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 699/1389] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:41.327916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfac60-f591-431c-8325-b4613df7afa4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:41.328489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfac60-f591-431c-8325-b4613df7afa4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:41.328489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfac60-f591-431c-8325-b4613df7afa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:41.403523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0ebfac60-f591-431c-8325-b4613df7afa4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:41.404746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0ebfac60-f591-431c-8325-b4613df7afa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:41.516185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 691/1390] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:41.587940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:41.588141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:41.588408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:41.589752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 700/1391] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:41.595158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbd4d-d2e6-4983-9d27-bd1b1fbcd733 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:41.595446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbd4d-d2e6-4983-9d27-bd1b1fbcd733 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:41.595760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bbd4d-d2e6-4983-9d27-bd1b1fbcd733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:41.612260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:41.664944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cc6bbd4d-d2e6-4983-9d27-bd1b1fbcd733 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:41.666431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cc6bbd4d-d2e6-4983-9d27-bd1b1fbcd733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:41.766947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 692/1392] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:41.807310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:41.809176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:41.960345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efa54f-9311-4b1a-9f0c-c82f3e17dbd0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:41.977540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:42.068938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabae0-858d-41aa-b117-6ea0af098b9a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:42.069248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabae0-858d-41aa-b117-6ea0af098b9a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:42.069519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadabae0-858d-41aa-b117-6ea0af098b9a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:42.070863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 693/1393] 10.222.0.85 () {54 vars in 967 bytes} [Wed Aug 24 04:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:46:42.075890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db08b-ab41-4f8a-b7d8-76ddb9ffeb9b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:42.076257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db08b-ab41-4f8a-b7d8-76ddb9ffeb9b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:42.076588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7db08b-ab41-4f8a-b7d8-76ddb9ffeb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:42.079077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:42.079842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:42.079992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:42.080251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:42.081857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:42.155814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7e7db08b-ab41-4f8a-b7d8-76ddb9ffeb9b None None] MFA Rules not processed for user `a773a16903bb41a9b871ddd3534e5873`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:42.157043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7e7db08b-ab41-4f8a-b7d8-76ddb9ffeb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:42.176386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:42.178019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:42.197681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:42.197900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 701/1394] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:42.246893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 694/1395] 10.222.0.85 () {58 vars in 1064 bytes} [Wed Aug 24 04:46:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:46:42.254954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:42.256212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:42.280030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:42.342714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700f75d-2761-4bad-aaae-9e2d232c8069 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:42.426318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:42.426919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:42.427192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:42.427458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:42.429088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:42.533596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:42.548275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:42.549723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602110e8-4f26-4809-9282-7e0b5a32d117 service glance] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:42.568383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 702/1396] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:43.309997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7254-2883-40b5-bade-0b018834f280 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:43.310535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7254-2883-40b5-bade-0b018834f280 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:43.310535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec7254-2883-40b5-bade-0b018834f280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:43.391123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c6ec7254-2883-40b5-bade-0b018834f280 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:43.392376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c6ec7254-2883-40b5-bade-0b018834f280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:43.492504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 695/1397] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:43.535240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:43.535768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:43.535873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:43.537203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 703/1398] 10.222.0.85 () {54 vars in 943 bytes} [Wed Aug 24 04:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:43.543698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abf98-d1ff-43c6-8052-3cd4e057d933 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:43.543988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abf98-d1ff-43c6-8052-3cd4e057d933 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:43.544265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6abf98-d1ff-43c6-8052-3cd4e057d933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:43.605300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:43.623952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5b6abf98-d1ff-43c6-8052-3cd4e057d933 None None] MFA Rules not processed for user `c3a2418aa8404c7995c1e8a84ae66627`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:43.625167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b6abf98-d1ff-43c6-8052-3cd4e057d933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:43.754907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 696/1399] 10.222.0.85 () {58 vars in 1040 bytes} [Wed Aug 24 04:46:43 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:43.764854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:43.766534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:43.921750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55a2ee-c9e2-49d2-9a5f-f44274c90132 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:43.995966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:44.037048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:44.037665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:44.037942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:44.038209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:44.039895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:44.126661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:44.128317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559c1fa-7ce3-4d74-a7d6-49e04798fa9e service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:44.136701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 704/1400] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:46:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:46:44.192146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:44.192435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:44.192709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:44.194439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 697/1401] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:44.199815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83840-ea0a-485f-9a2d-279438012538 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:44.200032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83840-ea0a-485f-9a2d-279438012538 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:44.200321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd83840-ea0a-485f-9a2d-279438012538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:44.277677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-bbd83840-ea0a-485f-9a2d-279438012538 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:44.278891 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bbd83840-ea0a-485f-9a2d-279438012538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:44.340366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:44.395138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 705/1402] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:44.694033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:44.695581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:44.819730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:44.867837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d0eaa-947c-482a-9673-c39aad408d7f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:45.002217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:45.002835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:45.003242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:45.003553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:45.005814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:45.090377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:45.114327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:45.115986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db214cbd-fb65-40cb-acfb-0fbaf2a15816 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:45.140897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 698/1403] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:47.160335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:47.160863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:47.160863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:47.162388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 706/1404] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:47.167550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530053-9ca1-43d0-af3f-3daa4ee9383e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:47.168005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530053-9ca1-43d0-af3f-3daa4ee9383e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:47.168294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530053-9ca1-43d0-af3f-3daa4ee9383e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:47.248315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ba530053-9ca1-43d0-af3f-3daa4ee9383e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:47.249990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ba530053-9ca1-43d0-af3f-3daa4ee9383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:47.370110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 699/1405] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:47.663681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:47.666483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:47.839388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6109ce-1542-4db2-9409-027a2ee4cf37 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:47.900252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:47.990905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:47.991437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:47.991760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:47.992009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:47.993667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:48.100827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:48.102481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735665a-e6b8-4015-ab73-1513fce12115 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:48.125708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 707/1406] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:46:50.164234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:50.165172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:50.165708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:50.167303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 700/1407] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:46:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:46:50.174215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703467d8-a59a-4ac5-81cc-2d6029147c0f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:50.174963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703467d8-a59a-4ac5-81cc-2d6029147c0f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:50.174963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703467d8-a59a-4ac5-81cc-2d6029147c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:50.232052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:50.247197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-703467d8-a59a-4ac5-81cc-2d6029147c0f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:46:50.248510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-703467d8-a59a-4ac5-81cc-2d6029147c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:50.363513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 708/1408] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:46:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:46:50.650554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:46:50.652237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:50.709743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:50.828978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b649dfc-4e78-4464-b775-2409feaf0089 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:46:50.963771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:46:50.964396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:46:50.964658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:46:50.964930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:46:50.966530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:46:50.977171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:46:51.074342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:46:51.076033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a937b-dfc5-40f0-b2ce-9d3285aef911 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:46:51.096675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 701/1409] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:00.359253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=46 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:01.093930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=41 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:06.993558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be379-5a5d-46c6-bfbd-e452adac41f6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:06.994144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be379-5a5d-46c6-bfbd-e452adac41f6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:06.994144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439be379-5a5d-46c6-bfbd-e452adac41f6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:06.995507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 709/1410] 10.222.0.85 () {54 vars in 918 bytes} [Wed Aug 24 04:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:07.001427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf8d2-4a7c-455a-a328-70d7958dc85f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:07.001876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf8d2-4a7c-455a-a328-70d7958dc85f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:07.001987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf8d2-4a7c-455a-a328-70d7958dc85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:07.077629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-33adf8d2-4a7c-455a-a328-70d7958dc85f None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:07.078862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-33adf8d2-4a7c-455a-a328-70d7958dc85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:07.187421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 702/1411] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Aug 24 04:47:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:07.202174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c2d4-3751-4a48-982a-1822ee7c326c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:07.202455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c2d4-3751-4a48-982a-1822ee7c326c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:07.202729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2c2d4-3751-4a48-982a-1822ee7c326c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:07.204107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 710/1412] 10.222.0.85 () {54 vars in 918 bytes} [Wed Aug 24 04:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:07.209119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f45e7-e0a0-48b3-a8c9-2f91a6e670ae None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:07.209410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f45e7-e0a0-48b3-a8c9-2f91a6e670ae None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:07.209688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f45e7-e0a0-48b3-a8c9-2f91a6e670ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:07.285910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:07.289378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f05f45e7-e0a0-48b3-a8c9-2f91a6e670ae None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:07.290980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f05f45e7-e0a0-48b3-a8c9-2f91a6e670ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:07.410854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 703/1413] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Aug 24 04:47:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:09.959493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:09.960102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:09.960102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:09.961366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:09.967328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668981a-8242-4894-8395-5407b632d76e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:09.967772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668981a-8242-4894-8395-5407b632d76e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:09.967920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668981a-8242-4894-8395-5407b632d76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:10.034528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4668981a-8242-4894-8395-5407b632d76e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:10.035760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4668981a-8242-4894-8395-5407b632d76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:10.090694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:10.133506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:10.422427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:10.424013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:10.571999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e44f2-f961-4abf-af80-b2b21d5a5321 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:10.643975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:10.687588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:10.688100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:10.688381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:10.688655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:10.690274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:10.780561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:10.782188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a710e54-59c9-4cb6-9379-30f3b88ba284 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:10.801895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 712/1416] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:11.702170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:11.702783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:11.702783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:11.704120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:47:11.709364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb18b-c6f9-45de-b882-e212465f625b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:11.709782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb18b-c6f9-45de-b882-e212465f625b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:11.709906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebb18b-c6f9-45de-b882-e212465f625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:11.790417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8cebb18b-c6f9-45de-b882-e212465f625b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:11.791683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8cebb18b-c6f9-45de-b882-e212465f625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:11.820048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:11.893957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:12.046207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:12.047862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:12.195011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee00f45-5ca5-4af4-bf78-027dc5e66870 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:12.236280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:12.310700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:12.311206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:12.311502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:12.311776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:12.313906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:12.406195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:12.407839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e262a24d-4ba2-4750-a30b-9eda0f245d0b service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:12.426469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 706/1419] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:47:13.316147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:13.316688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:13.316688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:13.317950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:13.322840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc11c6-8032-4140-bb7c-ed6a09a098fb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:13.323290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc11c6-8032-4140-bb7c-ed6a09a098fb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:13.323487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc11c6-8032-4140-bb7c-ed6a09a098fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:13.380444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:13.402836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d9fc11c6-8032-4140-bb7c-ed6a09a098fb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:13.404240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9fc11c6-8032-4140-bb7c-ed6a09a098fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:13.504068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:13.663840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:13.665347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:13.820634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28755029-5148-44b5-af42-06524b8cfbf2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:13.833496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:13.936452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:13.936970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:13.937243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:13.937507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:13.939110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:14.029982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:14.031631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753a2af9-74cc-45be-a4e0-21c43f44c3e0 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:14.049591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 715/1422] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:14.923374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:14.923970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:14.923970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:14.925306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:14.930542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1640ee-ab52-404d-b84b-db28b72fa68a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:14.930981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1640ee-ab52-404d-b84b-db28b72fa68a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:14.931083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1640ee-ab52-404d-b84b-db28b72fa68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:14.950775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:15.007205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-db1640ee-ab52-404d-b84b-db28b72fa68a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:15.008440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-db1640ee-ab52-404d-b84b-db28b72fa68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:15.115267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:15.268787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:15.270305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:15.382484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:15.419749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471701e-e34f-4bcc-8b71-5b03a3b04035 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:15.535346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:15.535906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:15.536184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:15.536456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:15.538058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:15.619832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:15.636180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:15.638769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c52b01-1b69-491c-900c-34fd0b96afcc service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:15.660688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 709/1425] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:16.533527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:16.534012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:16.534108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:16.535391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:16.540358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042679e4-7bf9-4154-b98e-c73f80696616 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:16.540812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042679e4-7bf9-4154-b98e-c73f80696616 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:16.540919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042679e4-7bf9-4154-b98e-c73f80696616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:16.619387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-042679e4-7bf9-4154-b98e-c73f80696616 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:16.620637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-042679e4-7bf9-4154-b98e-c73f80696616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:16.721378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:16.874110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:16.875656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:16.960714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:17.025010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89cf20e-3900-4e7c-9827-9a0043d382a0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:17.142023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:17.142634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:17.142917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:17.143187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:17.144831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:17.193881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:17.237322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:17.239064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32365137-70a0-4f9d-a6df-574a9d424792 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:17.257229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 718/1428] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:18.083639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:18.084219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:18.084219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:18.085584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:18.090487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9f-d160-4398-9de8-17b66579f0c6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:18.091445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9f-d160-4398-9de8-17b66579f0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:18.091677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb89fd9f-d160-4398-9de8-17b66579f0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:18.166248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fb89fd9f-d160-4398-9de8-17b66579f0c6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:18.167447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fb89fd9f-d160-4398-9de8-17b66579f0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:18.267285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:18.420435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:18.421890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:18.472846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:18.573404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ea96f-faf8-4155-9a81-6d8cd5f72a42 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:18.693216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:18.693732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:18.694006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:18.694274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:18.695883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:18.704423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:18.796488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:18.798094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f904d5c9-fc91-49f3-bea9-20cc6904004d service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:18.817006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 712/1431] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:47:19.622101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:19.622678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:19.622678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:19.624048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:19.628976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6797c7-cb3e-457e-a5b0-eab016b4ff91 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:19.629440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6797c7-cb3e-457e-a5b0-eab016b4ff91 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:19.629541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6797c7-cb3e-457e-a5b0-eab016b4ff91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:19.711462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1b6797c7-cb3e-457e-a5b0-eab016b4ff91 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:19.712715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b6797c7-cb3e-457e-a5b0-eab016b4ff91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:19.783143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:19.814610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:19.968861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:19.970379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:19.989313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:20.137389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22433c04-752b-4e59-b526-eb019a8df6f0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:20.235362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:20.261598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:20.262241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:20.262599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:20.263244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:20.264522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:20.357779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:20.359358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a02d9a-f2a1-45db-8fe4-e60c3e1a859c service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:20.378210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 721/1434] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:21.191733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:21.192306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:21.192306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:21.193652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:21.198762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0d92-a7f0-46cd-b10e-b2c1fd0d2b2d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:21.199152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0d92-a7f0-46cd-b10e-b2c1fd0d2b2d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:21.199310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea0d92-a7f0-46cd-b10e-b2c1fd0d2b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:21.280750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-caea0d92-a7f0-46cd-b10e-b2c1fd0d2b2d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:21.281972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-caea0d92-a7f0-46cd-b10e-b2c1fd0d2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:21.326136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:21.383813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:21.537843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:21.539390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:21.698804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f77aee-b688-4460-a266-8c0d319d5459 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:21.756392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:21.821210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:21.821812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:21.822091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:21.822362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:21.823996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:21.914017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:21.915565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2f2c-2830-479f-ae99-37fbca08579e service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:21.934026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 715/1437] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:22.749495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:22.750018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:22.750018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:22.751277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:22.756177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f231-fd4d-476d-b896-f67c44406f2c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:22.756622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f231-fd4d-476d-b896-f67c44406f2c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:22.756762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a495f231-fd4d-476d-b896-f67c44406f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:22.834352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a495f231-fd4d-476d-b896-f67c44406f2c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:22.835597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a495f231-fd4d-476d-b896-f67c44406f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:22.837640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:22.940795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:23.091699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:23.093226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:23.248490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc1d4b-9228-436a-9249-d3f3f9ef9b17 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:23.276392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:23.365659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:23.366180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:23.366452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:23.366718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:23.368331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:23.467494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:23.469126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ff7835-3dae-49bc-b64e-ef8d8d056b75 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:23.487335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 724/1440] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:25.297767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:25.298277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:25.298277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:25.299615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:25.306072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685b75-cfdd-4de5-a3b4-e097059a2782 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:25.306549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685b75-cfdd-4de5-a3b4-e097059a2782 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:25.306665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5685b75-cfdd-4de5-a3b4-e097059a2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:25.350859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:25.380767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a5685b75-cfdd-4de5-a3b4-e097059a2782 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:25.382088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a5685b75-cfdd-4de5-a3b4-e097059a2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:25.482983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:25.787026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:25.788592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:25.894366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a270e-0f62-47c1-9399-767be5e66ad5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:25.928113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:25.970853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:25.971459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:25.971768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:25.972039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:25.973641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:26.084226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:26.085580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db27aa33-0092-49c4-9c6f-33ef0f6eb5ca service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:26.104199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 718/1443] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:28.166907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:28.167453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:28.167453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:28.168852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:28.174765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8c2d-768f-4dd6-b046-d72e439607c6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:28.175238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8c2d-768f-4dd6-b046-d72e439607c6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:28.175347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f8c2d-768f-4dd6-b046-d72e439607c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:28.243708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-407f8c2d-768f-4dd6-b046-d72e439607c6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:28.244920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-407f8c2d-768f-4dd6-b046-d72e439607c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:28.259811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:28.345353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:28.633348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:28.634932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:28.860960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee683af4-4ad1-4cea-b1dd-f746317f49cc None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:28.873856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:28.937397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:28.938005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:28.938273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:28.938541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:28.940164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:29.047627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:29.049506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c129e7-dbec-4765-9d6e-79011817ade9 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:29.067659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 727/1446] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:31.325597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:31.326156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:31.326156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:31.327730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:31.333166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0417-5c01-4416-b823-a21d7a11f678 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:31.333577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0417-5c01-4416-b823-a21d7a11f678 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:31.333730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab0417-5c01-4416-b823-a21d7a11f678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:31.385458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:31.405448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-16ab0417-5c01-4416-b823-a21d7a11f678 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:31.406715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-16ab0417-5c01-4416-b823-a21d7a11f678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:31.512897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:31.810683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:31.812292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:31.918684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a00ee-1dd0-4e10-8f17-7eeddc2a8a5e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:31.962975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:31.997231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:31.998349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:31.998708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:31.998876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:32.000506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:32.117018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:32.118429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f3b8a-7385-4d06-b6bf-030797df85ee service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:32.139562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 721/1449] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:34.190881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:34.191494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:34.191494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:34.192831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:34.198378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb846edd-64d6-4623-9069-6dedb2ac2613 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:34.198813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb846edd-64d6-4623-9069-6dedb2ac2613 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:34.199061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb846edd-64d6-4623-9069-6dedb2ac2613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:34.266777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fb846edd-64d6-4623-9069-6dedb2ac2613 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:34.268149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fb846edd-64d6-4623-9069-6dedb2ac2613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:34.289471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:34.370157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:34.656995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:34.658566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:34.767119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f30de8-fa6e-4b7f-a95d-581e9157ce25 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:34.787141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:34.843327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:34.843964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:34.844242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:34.844514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:34.846118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:34.957695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:34.959128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af49c21-378c-444a-b8f6-7aae9bc00bc7 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:34.978190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 730/1452] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:36.972098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:36.972686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:36.972686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:36.974013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:36.979282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c88c5-1272-418f-9b11-981b76f095cb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:36.979717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c88c5-1272-418f-9b11-981b76f095cb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:36.979870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c88c5-1272-418f-9b11-981b76f095cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:37.045178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:37.048369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d27c88c5-1272-418f-9b11-981b76f095cb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:37.049984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d27c88c5-1272-418f-9b11-981b76f095cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:37.149053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:37.437882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:37.439491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:37.664216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9969ee06-505b-452d-9d16-e6151af1892c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:37.714950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:37.741179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:37.741778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:37.742049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:37.742318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:37.743944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:37.862082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:37.863543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83724041-06ba-42f0-8913-b17d60088593 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:37.881975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 724/1455] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:39.894150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:39.894150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:39.894150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:39.895704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:39.901875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb22a-c12f-42ef-9d13-b7ef0226c755 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:39.902444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb22a-c12f-42ef-9d13-b7ef0226c755 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:39.902444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9eb22a-c12f-42ef-9d13-b7ef0226c755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:39.970653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cf9eb22a-c12f-42ef-9d13-b7ef0226c755 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:39.971915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cf9eb22a-c12f-42ef-9d13-b7ef0226c755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:40.000634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:40.069295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:47:40.355001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:40.356639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:40.463818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866dffa-a7c5-4f5a-8a20-f4328cc12bb6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:40.492939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:40.538824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:40.539424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:40.539732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:40.540002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:40.541592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:40.650513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:40.651894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaeee7-641e-4c04-9976-5224b17304ff service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:40.670854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 733/1458] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:42.651018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:42.651588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:42.651588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:42.652987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:42.659173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c052-c0eb-4220-aedb-498fb6311615 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:42.659622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c052-c0eb-4220-aedb-498fb6311615 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:42.659762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77c052-c0eb-4220-aedb-498fb6311615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:42.726564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fc77c052-c0eb-4220-aedb-498fb6311615 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:42.727868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fc77c052-c0eb-4220-aedb-498fb6311615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:42.736863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:42.828492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:43.117438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:43.119007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:43.224850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e106b-1f63-4db2-a857-d4099bb0f40f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:43.281283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:43.300295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:43.300900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:43.301175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:43.301444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:43.303034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:43.411262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:43.412625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c02e9a-6327-4ef7-8d2b-f24ba976c211 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:43.430705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 727/1461] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:45.419082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:45.419612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:45.419612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:45.420917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:45.426324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54839-e8e5-4106-acb8-8bf5a2f26e12 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:45.426774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54839-e8e5-4106-acb8-8bf5a2f26e12 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:45.426883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c54839-e8e5-4106-acb8-8bf5a2f26e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:45.495479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-14c54839-e8e5-4106-acb8-8bf5a2f26e12 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:45.496708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-14c54839-e8e5-4106-acb8-8bf5a2f26e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:45.536081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:45.596309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:45.898923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:45.900499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:46.006147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d77107-ea70-499f-911e-90f6c95043ea None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:46.043598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:46.080624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:46.081232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:46.081508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:46.081777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:46.083379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:46.192677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:46.194018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905f4f8-79fc-49b4-8440-e53c02935ab9 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:46.215491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 736/1464] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:48.178811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:48.179648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:48.179648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:48.181006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:48.186623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3caf9-158a-4514-aa3b-a44eb1bb285a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:48.187071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3caf9-158a-4514-aa3b-a44eb1bb285a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:48.187182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3caf9-158a-4514-aa3b-a44eb1bb285a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:48.255682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3be3caf9-158a-4514-aa3b-a44eb1bb285a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:48.256837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3be3caf9-158a-4514-aa3b-a44eb1bb285a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:48.276394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:48.357876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:48.641464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:48.643293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:48.755684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf9eda-3eb1-4811-9ffb-604c952d82ba None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:48.826651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:48.833925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:48.834528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:48.834806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:48.835074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:48.836702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:48.947100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:48.948459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ca06c-5714-483d-b6ea-59343ff5e172 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:48.967344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 730/1467] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:47:50.907948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:50.908526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:50.908526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:50.909826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:47:50.915420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9f56-1380-4f2b-afd8-8551a9cc9882 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:50.915872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9f56-1380-4f2b-afd8-8551a9cc9882 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:50.916006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e9f56-1380-4f2b-afd8-8551a9cc9882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:50.985076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7d5e9f56-1380-4f2b-afd8-8551a9cc9882 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:47:50.986294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7d5e9f56-1380-4f2b-afd8-8551a9cc9882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:51.034901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:51.084566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:47:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:47:51.369883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:47:51.371533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:51.486599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8848950a-0768-45c6-99dd-5d043124c3c3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:47:51.535550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:47:51.562688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:47:51.563283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:47:51.563592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:47:51.563852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:47:51.565441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:47:51.680390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:47:51.681869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921811d-df61-48e7-97fc-6af9b6877c30 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:47:51.702049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 739/1470] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:01.082722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=22 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:01.698574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=66 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:11.547420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc6b0-896c-4b5a-992d-b5f7b465b6f3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:11.548045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc6b0-896c-4b5a-992d-b5f7b465b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:11.548045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cc6b0-896c-4b5a-992d-b5f7b465b6f3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:11.549380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 732/1471] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:11.555062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a74a-5114-42f8-a02c-bee4217d2d81 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:11.555509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a74a-5114-42f8-a02c-bee4217d2d81 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:11.555616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3a74a-5114-42f8-a02c-bee4217d2d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:11.622082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ffb3a74a-5114-42f8-a02c-bee4217d2d81 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:11.623285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ffb3a74a-5114-42f8-a02c-bee4217d2d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:11.724734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 740/1472] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:12.026215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:12.026502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:12.027441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:12.028992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 733/1473] 10.222.0.85 () {54 vars in 967 bytes} [Wed Aug 24 04:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:12.033997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d796-3c97-4cbb-975f-859245ec0be6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:12.034280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d796-3c97-4cbb-975f-859245ec0be6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:12.034553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393d796-3c97-4cbb-975f-859245ec0be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:12.119254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f393d796-3c97-4cbb-975f-859245ec0be6 None None] MFA Rules not processed for user `a773a16903bb41a9b871ddd3534e5873`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:12.120478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f393d796-3c97-4cbb-975f-859245ec0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:12.141175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:12.197428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 741/1474] 10.222.0.85 () {58 vars in 1064 bytes} [Wed Aug 24 04:48:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:12.205904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:12.207551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:12.312492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae81ca-e1ba-42e7-9ff3-1d90fbebd877 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:12.391015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:12.391669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:12.391950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:12.392217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:12.393822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:12.450135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:12.506776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:12.508227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c5d1b2-c139-4a0f-9e1b-fa5053edb44a service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:12.527169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 734/1475] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:14.538397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:14.538911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:14.539023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:14.540330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 742/1476] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:14.545757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdc38-0d78-425b-8c68-603237176de6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:14.546180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdc38-0d78-425b-8c68-603237176de6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:14.546434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdc38-0d78-425b-8c68-603237176de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:14.613180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-87abdc38-0d78-425b-8c68-603237176de6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:14.614402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-87abdc38-0d78-425b-8c68-603237176de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:14.712659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 735/1477] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:14.987119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:14.988723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:15.122414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96a6cb-a8de-49f8-8795-1894c35a47d9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:15.171901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:15.218776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:15.219376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:15.219689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:15.219956 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:15.220584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:15.222333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:48:15.222333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:48:15.222333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:48:15.223442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92b7ce-3881-4129-9fe9-07ac6bef2637 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:15.242294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 743/1478] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Aug 24 04:48:14 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:48:17.197726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:17.198349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:17.198349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:17.200282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 736/1479] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:17.205551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac475-f7aa-4bc1-a197-7a9d68702c03 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:17.206019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac475-f7aa-4bc1-a197-7a9d68702c03 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:17.206115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aac475-f7aa-4bc1-a197-7a9d68702c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:17.274361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-36aac475-f7aa-4bc1-a197-7a9d68702c03 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:17.275620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-36aac475-f7aa-4bc1-a197-7a9d68702c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:17.378249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 744/1480] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:17.685223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:17.686950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:17.696805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:17.839577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c690b3-4467-4829-b59e-6fc7a093a053 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:17.923291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:17.957007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:17.957617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:17.957893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:17.958166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:17.959794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:18.050212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:18.051884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc05e8c-5038-41fd-9ba9-93e2cf3c7e1b service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:18.071363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 737/1481] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:20.196232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:20.196766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:20.196766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:20.198145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 745/1482] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:20.203764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944eb0a-e034-427f-993e-2791c7ecdf49 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:20.204204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944eb0a-e034-427f-993e-2791c7ecdf49 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:20.204313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944eb0a-e034-427f-993e-2791c7ecdf49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:20.270983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9944eb0a-e034-427f-993e-2791c7ecdf49 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:20.272260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9944eb0a-e034-427f-993e-2791c7ecdf49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:20.318809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:20.370058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 738/1483] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:20.660278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:20.661885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:20.686736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:20.768345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4b87d-fe68-4b6d-be50-672c196c06b5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:20.855963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:20.856577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:20.856857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:20.857128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:20.858743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:20.934873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:20.970623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:20.972126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facdf55-4da2-4c35-a4ca-6ccbda930ae8 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:20.991001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 746/1484] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:22.964654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:22.966108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:22.966108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:22.967153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 739/1485] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:22.972439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad8f2-a9e2-4368-9c14-6756bc87f396 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:22.972888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad8f2-a9e2-4368-9c14-6756bc87f396 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:22.972997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ad8f2-a9e2-4368-9c14-6756bc87f396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:23.039130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6d5ad8f2-a9e2-4368-9c14-6756bc87f396 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:23.040366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6d5ad8f2-a9e2-4368-9c14-6756bc87f396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:23.139547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 747/1486] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:23.429246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:23.430809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:23.536232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765717d8-4d49-4beb-a846-a58ad85763c3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:23.609718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:23.611802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:23.612422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:23.612887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:23.613399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:23.615247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:23.728315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:23.729689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55194baa-c02a-44ed-b1c7-cc5d3b50e5d3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:23.748569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 740/1487] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:25.869173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:25.869709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:25.869709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:25.871171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 748/1488] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:25.876719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7740b-8ef8-4bb5-8d06-0c828abdc9f0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:25.877128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7740b-8ef8-4bb5-8d06-0c828abdc9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:25.877300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7740b-8ef8-4bb5-8d06-0c828abdc9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:25.945488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-70d7740b-8ef8-4bb5-8d06-0c828abdc9f0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:25.946689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70d7740b-8ef8-4bb5-8d06-0c828abdc9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:26.000238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:26.044702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 741/1489] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:26.343687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:26.345221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:26.382013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:26.452705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32878e9-bda5-4c8e-9dbc-4bfe7b4f93aa None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:26.529464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:26.530071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:26.530348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:26.530614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:26.532288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:26.613373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:26.641850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:26.643284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b9eef-9742-4b41-a72a-71951876fd9a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:26.663003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 749/1490] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:28.810517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:28.811058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:28.811181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:28.812509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 742/1491] 10.222.0.85 () {54 vars in 927 bytes} [Wed Aug 24 04:48:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:48:28.817929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81d10-f3ba-480e-9795-5f3407c83eef None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:28.818377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81d10-f3ba-480e-9795-5f3407c83eef None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:28.818470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb81d10-f3ba-480e-9795-5f3407c83eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:28.889720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7cb81d10-f3ba-480e-9795-5f3407c83eef None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:48:28.890936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7cb81d10-f3ba-480e-9795-5f3407c83eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:28.986980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 750/1492] 10.222.0.85 () {58 vars in 1024 bytes} [Wed Aug 24 04:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:48:29.271706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:48:29.273239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:29.378571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730da7-a478-4e6a-9df6-0b7312a149da None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:48:29.454215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:48:29.454829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:48:29.455103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:48:29.455372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:48:29.457020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:48:29.467440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:29.568011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:48:29.569456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dc5f5f-51d2-49d4-82bd-d67d7d7f440d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:48:29.588036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 743/1493] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:48:38.985202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=82 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:48:39.585751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=50 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:47.742310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.742877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.742877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:47.821074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:47.822334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:47.926890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 751/1494] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:47.935741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:47.936229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:47.936346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.012950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:48.014165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.113545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 744/1495] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:48.118206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.119404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.131948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab078fd5-7d07-4bd0-9783-e5bc37c84af7 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.194305 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.231521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.232136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.232413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.232682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.233327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:49:48.233626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.234635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:48.234635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:49:48.234635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:49:48.235532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.247289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 752/1496] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:49:48.255829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.266047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890c28-f56a-466e-a472-268035f0a4ad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.333208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.374926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.375652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.375767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.375944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.376616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.378372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:48.378372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:49:48.378372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:49:48.379610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.438403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 745/1497] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:49:48 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:48.442858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.444631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.479570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93982-d9ff-4699-a9bb-14afb4ab9aa9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.577321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.577847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.578124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.578394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.579025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.580058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:48.580058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:49:48.580058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:49:48.581254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.624906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 753/1498] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:49:48 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:49:48.629034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.630549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.698989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b092bee-1ca7-42b3-85ee-71e8198eebfb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.791976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.804704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.805315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.805589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.805871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.806511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.807539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:48.807539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:49:48.807539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:49:48.809027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.821508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 746/1499] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:48.825943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.827557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:48.838655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cb774-375f-4f1a-8d55-b3d39998c1a3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:48.864025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:48.942367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:48.942993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:48.943239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:48.943544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:48.944188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:48.945188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:48.945188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:49:48.945188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:49:48.946072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b1f34-4647-42f0-ac69-5fc982f8cf31 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:48.959853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 754/1500] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:49:48.966691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:48.970898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.005631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45cdf-c792-4612-aa0c-d371587c9896 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.098963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.099560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.099835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.100105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] PATH_INFO: `/v3/projects/72ac64f6f0634a0f84be746d750bdb3f/users/852ff888eaf84a3d9aa43041794c4ad1/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.122642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ac64f6f0634a0f84be746d750bdb3f, user_id=852ff888eaf84a3d9aa43041794c4ad1, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.123691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:49.123691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:49:49.123691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:49:49.125632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed8c6a-77e1-4532-b5eb-ef8f8f166430 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.153650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 747/1501] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:49:48 2022] PUT /identity/v3/projects/72ac64f6f0634a0f84be746d750bdb3f/users/852ff888eaf84a3d9aa43041794c4ad1/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:49:49.165643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e6cf-3442-4675-b319-eff3fd3bd6df None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.165934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e6cf-3442-4675-b319-eff3fd3bd6df None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.166218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0e6cf-3442-4675-b319-eff3fd3bd6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.225316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-13b0e6cf-3442-4675-b319-eff3fd3bd6df None None] MFA Rules not processed for user `852ff888eaf84a3d9aa43041794c4ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:49.226552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-13b0e6cf-3442-4675-b319-eff3fd3bd6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.306015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 755/1502] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:49.320378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.320692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.320965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.322338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 748/1503] 10.222.0.85 () {54 vars in 964 bytes} [Wed Aug 24 04:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:49.327371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5bfc3-ac07-4e61-9a69-1d63c93a494c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.327694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5bfc3-ac07-4e61-9a69-1d63c93a494c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.327980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5bfc3-ac07-4e61-9a69-1d63c93a494c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.360834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:49.406273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-91e5bfc3-ac07-4e61-9a69-1d63c93a494c None None] MFA Rules not processed for user `35b6d6e1beae43fab3e5b1a32447540c`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:49.407528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-91e5bfc3-ac07-4e61-9a69-1d63c93a494c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.487241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 756/1504] 10.222.0.85 () {58 vars in 1061 bytes} [Wed Aug 24 04:49:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:49.495206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.497513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.550432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:49.605081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f276d8-81fa-47b2-9d96-90c91e7c2e05 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:49.680647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:49.681164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.681449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.681720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.683440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.784415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:49.785865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:49.789483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:49.805768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 749/1505] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:49:49.856235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caba10-c406-483a-928e-8858acca834e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:49.856670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caba10-c406-483a-928e-8858acca834e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:49.857010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90caba10-c406-483a-928e-8858acca834e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:49.859138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 757/1506] 10.222.0.85 () {52 vars in 830 bytes} [Wed Aug 24 04:49:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:49:49.863138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:49.864388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:49.969002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36382e41-f5f4-4c68-912f-15135e0165fb service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.066753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.067377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.067680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.067951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] PATH_INFO: `/v3/users/852ff888eaf84a3d9aa43041794c4ad1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.080311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=852ff888eaf84a3d9aa43041794c4ad1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.081323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:50.081323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:49:50.081323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:49:50.082532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.093515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:50.152803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '852ff888eaf84a3d9aa43041794c4ad1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.153348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '852ff888eaf84a3d9aa43041794c4ad1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.162326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '852ff888eaf84a3d9aa43041794c4ad1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.162754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '852ff888eaf84a3d9aa43041794c4ad1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.178257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '852ff888eaf84a3d9aa43041794c4ad1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:50.208991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 750/1507] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:49:49 2022] DELETE /identity/v3/users/852ff888eaf84a3d9aa43041794c4ad1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:49:50.213368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.213658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.213949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.273001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:49:50.274218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.352220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:50.368050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 758/1508] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:49:50.378517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:50.379787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.481618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e23878-6d25-4afb-b902-a8e53eb8ccf9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:50.537939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:49:50.560530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:50.561145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:50.561425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:50.561698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:50.563297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:50.674974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:50.676727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e132209-bdf5-4b8d-b6d5-6e2a3918b479 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:50.695928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 751/1509] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:49:51.036710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:49:51.038046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:49:51.049768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b545aa7-9a4a-492b-8718-a45999c58a9e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:49:51.152935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:49:51.153570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:49:51.153847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:49:51.154122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] PATH_INFO: `/v3/projects/72ac64f6f0634a0f84be746d750bdb3f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:49:51.165649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ac64f6f0634a0f84be746d750bdb3f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:49:51.166667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:49:51.166667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:49:51.166667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:49:51.167924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:49:51.226473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ac64f6f0634a0f84be746d750bdb3f', 'request_id': 'req-1c716471-7f16-4b54-a0a0-2a307f4a23b4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.233530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ac64f6f0634a0f84be746d750bdb3f', 'request_id': 'req-1c716471-7f16-4b54-a0a0-2a307f4a23b4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.243901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ac64f6f0634a0f84be746d750bdb3f', 'request_id': 'req-1c716471-7f16-4b54-a0a0-2a307f4a23b4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.275189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] The token cache is being invalidate because project 72ac64f6f0634a0f84be746d750bdb3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:49:51.275483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.275922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1c716471-7f16-4b54-a0a0-2a307f4a23b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:49:51.277407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 759/1510] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:49:51 2022] DELETE /identity/v3/projects/72ac64f6f0634a0f84be746d750bdb3f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:50:00.693553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=62 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:50:01.273177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:37.910809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.911415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.911415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:37.912826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:37.917840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3b36-d4ce-41d9-8b54-8e6c9b72ed0e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:37.918323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3b36-d4ce-41d9-8b54-8e6c9b72ed0e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:37.918458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f3b36-d4ce-41d9-8b54-8e6c9b72ed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:38.002091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-102f3b36-d4ce-41d9-8b54-8e6c9b72ed0e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:38.003318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-102f3b36-d4ce-41d9-8b54-8e6c9b72ed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:38.109851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:38.265012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:38.267128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:38.385582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad84db-0a7b-429b-848e-86ce77300521 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:38.391753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:38.392356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:38.392636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:38.392906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:38.400842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:38.402413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6630fa1-4bac-4e85-b201-c5ac3e915854 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:38.412233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 753/1513] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:39.259146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cfdb-f068-419b-afb1-dc285dfecd10 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.259715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cfdb-f068-419b-afb1-dc285dfecd10 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.259715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19cfdb-f068-419b-afb1-dc285dfecd10 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.261115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:39.265916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690106-3d92-47df-9f69-1105c0b2f183 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.266357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690106-3d92-47df-9f69-1105c0b2f183 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.266463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690106-3d92-47df-9f69-1105c0b2f183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.285447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e6690106-3d92-47df-9f69-1105c0b2f183 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:39.286636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e6690106-3d92-47df-9f69-1105c0b2f183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.294927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:39.447745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19cfdb-f068-419b-afb1-dc285dfecd10 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:39.461969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19cfdb-f068-419b-afb1-dc285dfecd10 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:39.467601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:39.468193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.468469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.468735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.476636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:39.478202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9debf-240e-4c8b-97cc-53ebff34d49e service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:39.488157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 762/1516] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:39.635398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f807e0-6bf8-4eee-b83a-3c47bc1c1d6a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.635721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f807e0-6bf8-4eee-b83a-3c47bc1c1d6a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.635998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f807e0-6bf8-4eee-b83a-3c47bc1c1d6a None None] PATH_INFO: `/v3` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.637409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 755/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Aug 24 04:51:39 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:51:39.644073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6796-cb38-47d1-b142-4c9227ad834b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:39.644360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6796-cb38-47d1-b142-4c9227ad834b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:39.644654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8af6796-cb38-47d1-b142-4c9227ad834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:39.706081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f8af6796-cb38-47d1-b142-4c9227ad834b None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:39.707211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f8af6796-cb38-47d1-b142-4c9227ad834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:39.724663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:51:39.782267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 763/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 04:51:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:48.925665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422be3-f1ef-404b-929c-59ebea634efe None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:48.926282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422be3-f1ef-404b-929c-59ebea634efe None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:48.926282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9422be3-f1ef-404b-929c-59ebea634efe None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:48.927646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 756/1519] 10.222.0.85 () {54 vars in 961 bytes} [Wed Aug 24 04:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:48.934114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d2ce-e628-4d12-a3ac-f69684ee64ec None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:48.934584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d2ce-e628-4d12-a3ac-f69684ee64ec None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:48.934689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4d2ce-e628-4d12-a3ac-f69684ee64ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:48.954383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-65f4d2ce-e628-4d12-a3ac-f69684ee64ec None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:48.955614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-65f4d2ce-e628-4d12-a3ac-f69684ee64ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:48.964092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 764/1520] 10.222.0.85 () {58 vars in 1058 bytes} [Wed Aug 24 04:51:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:48.972334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9422be3-f1ef-404b-929c-59ebea634efe None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:48.986024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9422be3-f1ef-404b-929c-59ebea634efe None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:48.990839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:48.991435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:48.991740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:48.992276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:49.000745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:49.002300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc171d06-8116-4373-8d48-8cd9e0662e4e service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:49.011993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 757/1521] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:50.726432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318043-4d6f-481b-8538-bf464abd619e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.727002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318043-4d6f-481b-8538-bf464abd619e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.727002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98318043-4d6f-481b-8538-bf464abd619e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.728361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:50.733303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b8e8-c0cd-4f0c-bca1-7c3e6a5c1630 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.733751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b8e8-c0cd-4f0c-bca1-7c3e6a5c1630 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.733873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c00b8e8-c0cd-4f0c-bca1-7c3e6a5c1630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.753419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3c00b8e8-c0cd-4f0c-bca1-7c3e6a5c1630 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:50.754534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3c00b8e8-c0cd-4f0c-bca1-7c3e6a5c1630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:50.762372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:51:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:50.918116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98318043-4d6f-481b-8538-bf464abd619e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:50.933231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98318043-4d6f-481b-8538-bf464abd619e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:50.938727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:50.939319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:50.939627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:50.939900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:50.949598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:50.951309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b835b-eaa2-42e6-b074-42232fb731f3 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:50.960913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 766/1524] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:51.778941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349966-062b-499e-939e-8e64234431bc None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.779766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349966-062b-499e-939e-8e64234431bc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.779766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6349966-062b-499e-939e-8e64234431bc None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.781511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 04:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:51.788316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aebe-6ca7-4a00-8c8b-4cba3a48baa0 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.789070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aebe-6ca7-4a00-8c8b-4cba3a48baa0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.789070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118aebe-6ca7-4a00-8c8b-4cba3a48baa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:51.809088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7118aebe-6ca7-4a00-8c8b-4cba3a48baa0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:51.810413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7118aebe-6ca7-4a00-8c8b-4cba3a48baa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:51.818431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 04:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:51.972654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6349966-062b-499e-939e-8e64234431bc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:51.986938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6349966-062b-499e-939e-8e64234431bc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:51.992340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:51.992928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:51.993206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:51.993476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:52.001402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:52.002995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd137-c837-446a-8128-bfec51cbad6a service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:52.012884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 760/1527] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:55.958278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:55.958848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:55.958848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:55.960305 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:55.965522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09980-3881-4fec-883a-42c28885421c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:55.965952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09980-3881-4fec-883a-42c28885421c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:55.966161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b09980-3881-4fec-883a-42c28885421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:55.985901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b3b09980-3881-4fec-883a-42c28885421c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:55.987105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b3b09980-3881-4fec-883a-42c28885421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:55.994914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:56.278520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:56.280449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:56.361034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb03d7dc-8d73-4820-a714-80b1f3a4edb0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:56.364857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:56.365466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:56.365749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:56.366024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:56.376340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:56.377773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761795b-a4ec-4c7d-90e1-08020aa6663d service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:56.391236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 769/1530] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:51:58.303325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142e13-3393-4c8d-9937-742cecd6edf2 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.303944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142e13-3393-4c8d-9937-742cecd6edf2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.303944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5142e13-3393-4c8d-9937-742cecd6edf2 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.305268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:51:58.310960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b0ac-07ac-4f8e-85a2-9366129e228e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.311359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b0ac-07ac-4f8e-85a2-9366129e228e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.311553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4b0ac-07ac-4f8e-85a2-9366129e228e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.331358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-abf4b0ac-07ac-4f8e-85a2-9366129e228e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:51:58.332593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-abf4b0ac-07ac-4f8e-85a2-9366129e228e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:51:58.340552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:51:58.632274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5142e13-3393-4c8d-9937-742cecd6edf2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:51:58.643606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5142e13-3393-4c8d-9937-742cecd6edf2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:51:58.647070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:51:58.647685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:51:58.647965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:51:58.648238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:51:58.657483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:51:58.658885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffd787-5061-4946-b074-7929f5525bbb service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:51:58.668456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 763/1533] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:02.098301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.098869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.098869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.100233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:52:02.105395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012662e5-28ab-4ea5-9177-f11b9399dbbd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.106470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012662e5-28ab-4ea5-9177-f11b9399dbbd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.106621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012662e5-28ab-4ea5-9177-f11b9399dbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.114414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=81 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:02.127139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-012662e5-28ab-4ea5-9177-f11b9399dbbd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:02.128376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-012662e5-28ab-4ea5-9177-f11b9399dbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.136190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:02.696926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:02.698661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:02.764889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:02.778731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718c33bd-aae6-4e98-b32d-c7bc26ef362f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:02.782335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:02.782941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:02.783221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:02.783516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:02.792815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:02.795327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b372489b-721d-42c2-bfd2-f7459b6ac757 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:02.805149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 772/1536] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:04.744075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.744591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.744591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.745871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 04:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:52:04.751659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143743-ebf3-4c7f-97af-e6a6451065ff None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:04.752104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143743-ebf3-4c7f-97af-e6a6451065ff None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:04.752211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2143743-ebf3-4c7f-97af-e6a6451065ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:04.771904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c2143743-ebf3-4c7f-97af-e6a6451065ff None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:52:04.773105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c2143743-ebf3-4c7f-97af-e6a6451065ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:04.781584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:52:05.331944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:52:05.333626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:52:05.346646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbf91bf-3c4e-4885-82ec-4034a6d4758b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:52:05.350217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:52:05.350808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:52:05.351085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:52:05.351378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:52:05.360876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:52:05.362279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4d34-da8c-4fe0-93af-5118c323f9e5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:52:05.372251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 766/1539] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:52:14.767278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=11 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:52:15.367529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:42.485358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.497178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.497178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.517132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.518360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.529130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 774/1540] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:53:42.538710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.539294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.539294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.572229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.573478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.589421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 767/1541] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.594558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:42.610202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21b26-f608-4e4c-bd5d-723750523573 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:42.617751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:42.618385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.618664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.618936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.619634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:42.619937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:42.621578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ea068-e8af-43c8-b5fc-d1a849c411ce admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:42.637695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 775/1542] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:42.645892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:42.655797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb862d-8689-46ba-9939-798e2c0d1455 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:42.679177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:42.679851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.680134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.680404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.681039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:42.683010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:42.738008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b77e-0489-4915-845e-056da55bf9d9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.738369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b77e-0489-4915-845e-056da55bf9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.738762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad31b77e-0489-4915-845e-056da55bf9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.750997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 768/1543] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:42.756082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:42.770831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ad31b77e-0489-4915-845e-056da55bf9d9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.772094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ad31b77e-0489-4915-845e-056da55bf9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.849119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db446222-847c-464f-98a9-e7ac847a3c5a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:42.853865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:42.854593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.854888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.855143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.855836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:42.857017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 776/1544] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:53:42.857142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:42.857142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:53:42.857142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:53:42.858031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48353c44-e620-44b5-8872-65aa6e5839c9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:42.858234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bf62-d59e-4d8f-b329-d05d40486c92 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.858516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bf62-d59e-4d8f-b329-d05d40486c92 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.858784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005bf62-d59e-4d8f-b329-d05d40486c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.882188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1005bf62-d59e-4d8f-b329-d05d40486c92 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.883399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1005bf62-d59e-4d8f-b329-d05d40486c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.884357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 769/1545] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:53:42.885831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0cbd-cb35-4787-a9b3-a4cd4d14f572 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.886259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0cbd-cb35-4787-a9b3-a4cd4d14f572 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.886630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df0cbd-cb35-4787-a9b3-a4cd4d14f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.892208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 777/1546] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.893282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176784-2225-4632-9dc9-98bfc6381695 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.893566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176784-2225-4632-9dc9-98bfc6381695 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.893838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176784-2225-4632-9dc9-98bfc6381695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.918755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a7df0cbd-cb35-4787-a9b3-a4cd4d14f572 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.919418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-dd176784-2225-4632-9dc9-98bfc6381695 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.921481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dd176784-2225-4632-9dc9-98bfc6381695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.921617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a7df0cbd-cb35-4787-a9b3-a4cd4d14f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.930456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 770/1547] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.930610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 778/1548] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.931511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446685f-6bed-4fa2-bc1f-c57e393ed174 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.931802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446685f-6bed-4fa2-bc1f-c57e393ed174 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.932081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446685f-6bed-4fa2-bc1f-c57e393ed174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.939071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.939360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.939655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.952358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6446685f-6bed-4fa2-bc1f-c57e393ed174 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.954241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6446685f-6bed-4fa2-bc1f-c57e393ed174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.959179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.960382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.962266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 779/1549] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.963447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ace0e-e519-4117-9d37-719046b5477f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.963759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ace0e-e519-4117-9d37-719046b5477f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.964031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ace0e-e519-4117-9d37-719046b5477f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.976438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 771/1550] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:42.977555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:42.987567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6d7ace0e-e519-4117-9d37-719046b5477f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:42.987791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af84ae-c8d9-4ba4-9afc-c9377472b89e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:42.988846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6d7ace0e-e519-4117-9d37-719046b5477f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:42.992299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:42.992897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:42.993235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:42.993437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:42.994068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:42.995676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2ca4f7-2ecf-4325-bcfd-4dc7ad11f299 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:42.996673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 780/1551] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.001504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28810-f1f8-4c4e-a2b1-8f55b585d796 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.001946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28810-f1f8-4c4e-a2b1-8f55b585d796 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.002065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe28810-f1f8-4c4e-a2b1-8f55b585d796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.006777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 772/1552] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:43.007187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee454ade-c22e-443b-8802-879918720dc7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.007488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee454ade-c22e-443b-8802-879918720dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.007821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee454ade-c22e-443b-8802-879918720dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.021975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ebe28810-f1f8-4c4e-a2b1-8f55b585d796 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.023170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ebe28810-f1f8-4c4e-a2b1-8f55b585d796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.026877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ee454ade-c22e-443b-8802-879918720dc7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.028091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ee454ade-c22e-443b-8802-879918720dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.031139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 781/1553] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.033255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd993b-c05b-4714-a794-318f84ad8830 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.033534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd993b-c05b-4714-a794-318f84ad8830 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.033802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd993b-c05b-4714-a794-318f84ad8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.039803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 773/1554] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.045022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5312a-dd08-4224-b982-b9e23261389c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.045022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5312a-dd08-4224-b982-b9e23261389c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.045022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5312a-dd08-4224-b982-b9e23261389c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.053034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-dfcd993b-c05b-4714-a794-318f84ad8830 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.054231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dfcd993b-c05b-4714-a794-318f84ad8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.062277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 782/1555] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.062700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-27b5312a-dd08-4224-b982-b9e23261389c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.063842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.063934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-27b5312a-dd08-4224-b982-b9e23261389c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.064272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.064468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.072220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 774/1556] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.073548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.073831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.074106 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.084158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.085400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.095126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.096354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.098383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 783/1557] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.099063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.105611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 775/1558] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.106281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.109069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186131c1-53d3-419b-85b5-066c2ad1ae90 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.114326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.114930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.115206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.115498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.116148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.116470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.116627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7b483-6ab0-4f66-9e92-911b7a1bc985 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.118083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.121190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.121778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.122058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.122329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.122990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.124586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c6e4f-902f-43d5-a934-67823c1ea1a2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.130435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 784/1559] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.131257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.143532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 776/1560] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:43.143716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380da8e0-3519-46d3-8f96-fe88524f2d53 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.143818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.143818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.143818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.146504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.147101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.147383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.147695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.148340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.148656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.151296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.161540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.162738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.164508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 785/1561] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.165267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.175894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64418e5f-f0c0-471e-b774-0c8990919cfc admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.178815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 777/1562] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.179662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.180550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.181138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.181479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.181756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.182395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.182702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.184316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.190154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f6c488-20ee-4123-8077-e292dfd971f8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.196185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.196440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 786/1563] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.196790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.197233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.197339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.197632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.198286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.198588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.199657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:43.199657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:53:43.199657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:53:43.200566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.207580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448ffd9-2721-4e81-af3c-da68a0ce6f87 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.212230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.212810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.213089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.213357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.214033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 778/1564] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.214152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.214276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.215399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.215898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.225764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135efc2-1e30-4966-88ec-f01869e987c5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.231647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 787/1565] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.231647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.235026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.235658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.235934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.236204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.236833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.237131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.238701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.241215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167c895-0f9a-4cff-a6f2-17ab36a93579 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.246228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.246815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.247095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.247484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.248116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.249137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:43.249137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:53:43.249137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:53:43.252202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.252322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 779/1566] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.253123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.264601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f022556-f536-4321-826a-19d79fa4be10 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.269956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.270598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.270882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.271184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] PATH_INFO: `/v3/projects/aec41d54d2e54cdd80b463f1c8af9b84/users/e87c835bd666445a826bd7e7871023c9/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.285294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 788/1567] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.286368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.290169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec41d54d2e54cdd80b463f1c8af9b84, user_id=e87c835bd666445a826bd7e7871023c9, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.292975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.302759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.311836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 780/1568] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:43 2022] PUT /identity/v3/projects/aec41d54d2e54cdd80b463f1c8af9b84/users/e87c835bd666445a826bd7e7871023c9/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:43.312005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.312142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.357427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c35f63-adb9-48f2-a4d0-d057a1ea2c86 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.372817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780531-4e92-4969-82af-0f83e9870dd3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.378274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.378875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.379154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.379427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.380101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:43.380399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.381985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.394315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 781/1569] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:43.395103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.404569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20d10a-a996-4bce-880e-ad84ed0cd7bc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.409981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.410559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.410837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.411109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.411753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.413626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.421685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.422846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.423129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.423401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.424073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.425961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.445485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 782/1570] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.445485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.461223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 789/1571] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.462341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.507890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfba191-3055-488c-8262-ef040059d8e5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.528042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1ba8c-dd1a-4f2c-852e-63a0be2d7bed admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.533657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.534259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.534538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.534806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.535422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.537349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.567676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 790/1572] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.567676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.567954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.567954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.567954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.567954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.568699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.570390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.599137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 783/1573] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.600047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.605918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.612930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.634958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2349c-88c3-456a-80d1-ca6c9d27247c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.664194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77388ea8-0b24-4880-b1fd-32546260192f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.668918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.669977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.669977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.670370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.671335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.673499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae524241-238b-4290-808f-1cbc5f852577 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.694858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 784/1574] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.696155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.696448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.696728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.698697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.699316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.699637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.699909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.700667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.702600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.716394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:43.717664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:43.726898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 785/1575] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:43.727761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.736677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 791/1576] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.737715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.740307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d861566-6874-4bcb-a84b-f5442c5d9b6c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.798010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.798630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.798913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.799189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.799844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.801739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.802384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792fc9e-6f8c-4970-b677-c5b0066728fb admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.807557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.808169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.808448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.808720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.809339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.811695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.829822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 786/1577] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.830928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.837727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 792/1578] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.837727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.846464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5625d57-11e9-4ee0-93c3-645b065e9c0e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.897172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da544a0-6660-4ce3-8e01-ab9b631f6652 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.901958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.902641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.903005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.903299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.904034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.904823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.905431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.905712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.905937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.906044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.906630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.908564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.916323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.929035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 787/1579] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 302 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.929910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.931684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 793/1580] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.932487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.938650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:43.942972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae931d0-75b4-48f7-b2f1-56faac58b77d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.943816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f224b10-c545-4e4e-9661-3637ddb395fb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.948091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.948685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.948965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.949239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.949637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.949908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.950229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.950507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.950778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.951413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.951566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.954768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:43.962663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 794/1581] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:43.964833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.975622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 788/1582] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:43.976424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:43.986153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186f0c95-1102-47f3-a4ca-a093cdc150b7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:43.991169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:43.991801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:43.992082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:43.992359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:43.992996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:43.994898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.020704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 789/1583] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:43 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:44.020704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.027928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa9f90-9336-4c43-84ad-56411041196e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.028829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d993637-64b4-405e-bfa6-b4acf92c5693 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.032871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.033044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.033454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.033587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.033734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.033842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.034005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.034101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.034624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.036554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.043764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.045829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.059807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 795/1584] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:44.059931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.060260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 790/1585] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:44.061262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.070549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f1632-d578-4892-a6bb-2728beb9c2e3 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.072336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb94f7-2531-4862-a45e-b31f465f3f03 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.075523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.076197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.076546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.076887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.076986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.077512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.077790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.077913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.078639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.079378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.080343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.081121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.092993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 791/1586] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.093666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 796/1587] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.094634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.096717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.106632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db78844-d9f4-487f-88de-426b5f3b5eff admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.107408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da936e7-378d-41b8-9e55-64a0ea407684 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.111726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.112247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.112558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.112845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.113026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.113161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.113384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.113545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.114026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.114426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.115642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.116440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.127622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 797/1588] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.131364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 792/1589] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.131551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.131745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.143123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b930-71fa-4245-baac-57e467bf472b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.143938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad4c17-06cb-46d4-80f0-9b5d63140d38 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.148411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.149111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.149264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.149518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.149859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.150069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.150424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.150686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.150914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.151731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.152750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.153624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.166452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 798/1590] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.167531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.168617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 793/1591] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.172448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.179030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc994506-329b-46de-b001-165bbd2e1ef6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.182952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d6eaa-30dc-4335-97a6-492274cadbd3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.183797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.184402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.184722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.184945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.185585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.187174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.188907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.189601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.190323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.190323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.190980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.192653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.200536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 799/1592] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.201773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.208414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 794/1593] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.208414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.214829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377f21-224c-480a-b95b-a10e3e290e89 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.216455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f567c92-7f82-4e6f-b690-8458901e8a53 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.221815 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.222160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.222645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.222996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.223360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] PATH_INFO: `/v3/projects/00eced53c40d4d9c86be7db0df33a7fb/users/0d7ec61bcb2c4c318d1b85c9dd61444e/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.223677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.224080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.224722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.225516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.228377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.240060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 800/1594] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.241612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00eced53c40d4d9c86be7db0df33a7fb, user_id=0d7ec61bcb2c4c318d1b85c9dd61444e, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.244113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.245122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.256078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed0700-6c22-4d4c-8894-b8324b1143ec admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.274088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 795/1595] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/00eced53c40d4d9c86be7db0df33a7fb/users/0d7ec61bcb2c4c318d1b85c9dd61444e/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.274088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.341753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.342471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.342823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.343189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.344041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.345887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.358318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c369a5-b3d4-49a2-afd0-a5b2cf3a6019 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.359123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 801/1596] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.360969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.364226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.364926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.365280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.365628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.366344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.368885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.371969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42b3bc4-b849-4bf8-aa83-e2955f08b12b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.377583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.378386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.378672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.378943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.379739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.384335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.384500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 796/1597] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.384500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.394074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 802/1598] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.395356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.399319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f1545-1633-4ddb-8d09-7ac7caf13907 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.405373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.405982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.406164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c06a-e052-42e3-9977-1467883add7f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.406373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.407158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.407877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.409456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.412155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.412548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.412828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.413099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] PATH_INFO: `/v3/projects/240606ab940649ae9e8193af6f958cda/users/8cb5a1922193425bb974b48d14c915a7/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.423226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 797/1599] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:44.423672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.427751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:44.436673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=240606ab940649ae9e8193af6f958cda, user_id=8cb5a1922193425bb974b48d14c915a7, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.437797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:44.437797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:53:44.437797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:53:44.438266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f4fb-5229-481b-b596-3c939827295d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.440620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361cd66-be11-4e44-90aa-b662a91601a5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.443204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.443930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.444214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.444492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] PATH_INFO: `/v3/projects/e24baea8cbb74113b5c5b891a4245b5c/users/9d247454fd674803ba080bb60ac2f645/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.457308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 803/1600] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/240606ab940649ae9e8193af6f958cda/users/8cb5a1922193425bb974b48d14c915a7/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.458425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.458710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.458985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.471234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e24baea8cbb74113b5c5b891a4245b5c, user_id=9d247454fd674803ba080bb60ac2f645, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.473971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.493900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] MFA Rules not processed for user `0d7ec61bcb2c4c318d1b85c9dd61444e`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:44.495257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:44.497320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 798/1601] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/e24baea8cbb74113b5c5b891a4245b5c/users/9d247454fd674803ba080bb60ac2f645/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.501152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.506785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:44.570225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 804/1602] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:44.571752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.575292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf724a4d-76ed-42fd-8ebc-b28b2e76026d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.580774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.581452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.581734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.582014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] PATH_INFO: `/v3/projects/26a288d5414446e68974ff81e6fe6bdc/users/7da49f610a644878bd319fea57b1b5b8/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.597000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1b70d-4682-48ff-8622-15798b9c0e61 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.598413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26a288d5414446e68974ff81e6fe6bdc, user_id=7da49f610a644878bd319fea57b1b5b8, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.601218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.602113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.602848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.603189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.603580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] PATH_INFO: `/v3/projects/6846942f10c44767ac61480891df2a0e/users/5eadf34dc91e4dd79d00a9e218117032/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.621276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 799/1603] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/26a288d5414446e68974ff81e6fe6bdc/users/7da49f610a644878bd319fea57b1b5b8/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.622466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.630171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6846942f10c44767ac61480891df2a0e, user_id=5eadf34dc91e4dd79d00a9e218117032, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.633007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.655677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 805/1604] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/6846942f10c44767ac61480891df2a0e/users/5eadf34dc91e4dd79d00a9e218117032/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.657766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:44.708677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62ac12-07b0-47e9-a56c-311228fc394b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.727128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fbaff-db5e-42df-a2ba-88d9a1e4bdde admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:44.732442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.733308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.733984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.734908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] PATH_INFO: `/v3/projects/341b3dadd2ef45a184e8d3432476107e/users/dca8e4596495412aa468e661d45756e9/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.753497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341b3dadd2ef45a184e8d3432476107e, user_id=dca8e4596495412aa468e661d45756e9, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.756168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed9a6d7-065b-47e6-9c2a-f54fd99659f7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.772730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 806/1605] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/341b3dadd2ef45a184e8d3432476107e/users/dca8e4596495412aa468e661d45756e9/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.774204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91eaf-8ffd-4875-9641-ab030fbe4a3b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.774490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91eaf-8ffd-4875-9641-ab030fbe4a3b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.774609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:44.774808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91eaf-8ffd-4875-9641-ab030fbe4a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.775239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.775601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.776036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] PATH_INFO: `/v3/projects/774adc483327412781f28e0c9b7cae91/users/0958d0bfe35c4f4aac3e00f0528b6674/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.792735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=774adc483327412781f28e0c9b7cae91, user_id=0958d0bfe35c4f4aac3e00f0528b6674, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:44.795399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b456fe8e-4162-478e-be50-250420cf17fc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:44.799051 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-dfe91eaf-8ffd-4875-9641-ab030fbe4a3b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:44.801003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dfe91eaf-8ffd-4875-9641-ab030fbe4a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:44.813803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 800/1606] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:44 2022] PUT /identity/v3/projects/774adc483327412781f28e0c9b7cae91/users/0958d0bfe35c4f4aac3e00f0528b6674/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:44.815310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd38-b123-4c54-8992-ffba4a360e6a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.815627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd38-b123-4c54-8992-ffba4a360e6a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.815905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d34bd38-b123-4c54-8992-ffba4a360e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.834591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7d34bd38-b123-4c54-8992-ffba4a360e6a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:44.835916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7d34bd38-b123-4c54-8992-ffba4a360e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:44.843142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:44.853973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:44.903025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 807/1607] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:44.904576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d5f-4f38-484b-aaf6-31de9a74810b None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.904870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d5f-4f38-484b-aaf6-31de9a74810b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.905152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c5d5f-4f38-484b-aaf6-31de9a74810b None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.910232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 808/1608] 10.222.0.85 () {54 vars in 962 bytes} [Wed Aug 24 04:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:53:44.910232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c6ba-7b56-455c-b914-6c4e195953e3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.910232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c6ba-7b56-455c-b914-6c4e195953e3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.910232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c6ba-7b56-455c-b914-6c4e195953e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.932003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2d80c6ba-7b56-455c-b914-6c4e195953e3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:44.933234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2d80c6ba-7b56-455c-b914-6c4e195953e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:44.942942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 801/1609] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:44.951896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cb11-7341-4d2d-871c-28f3b21a3196 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:44.952335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cb11-7341-4d2d-871c-28f3b21a3196 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:44.953049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029cb11-7341-4d2d-871c-28f3b21a3196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:44.991656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7029cb11-7341-4d2d-871c-28f3b21a3196 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:44.993077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7029cb11-7341-4d2d-871c-28f3b21a3196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.002382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 802/1610] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.003689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b67a27-e398-4fbc-b972-14d3f1a3b677 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.003979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b67a27-e398-4fbc-b972-14d3f1a3b677 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.004258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b67a27-e398-4fbc-b972-14d3f1a3b677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.013114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 809/1611] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.014700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.015143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.016241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.043405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-34b67a27-e398-4fbc-b972-14d3f1a3b677 None None] MFA Rules not processed for user `dca8e4596495412aa468e661d45756e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:45.045302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-34b67a27-e398-4fbc-b972-14d3f1a3b677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.056903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] MFA Rules not processed for user `0958d0bfe35c4f4aac3e00f0528b6674`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:45.058640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.135729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 803/1612] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.135729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.135729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.135729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.138509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 810/1613] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.139693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.192818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:45.195214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.232183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d59c3e2-40a4-45fc-afaa-80858b2e20b5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.237193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.238037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.238568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.239007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.251759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.253828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.267089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 811/1614] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.268160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.269718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.278249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 804/1615] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.279682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.285630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374a63d-80b3-4ddc-9dcf-a29451bf058a service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.290052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.290830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.291223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.291632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.291862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d3159-3938-4fcf-9db8-f49d1730d9a9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.296539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.297363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.297827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.298280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.300857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:45.304143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.305951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.310548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.312495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.322202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 812/1616] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.323589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.324441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 805/1617] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.325504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.333176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:45.336886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f6879-238b-41ef-ae04-4a71fb6c5402 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.337994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd54f8-fa54-40aa-9baf-d2044895a101 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.342102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.342886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.344656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.345085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.347666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.348379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.348664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.349079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.349898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.352737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc1876f-3eb6-407d-bb50-2967225b4d0e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.363801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.365801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6014a-77e2-474c-99fd-5d26f7ab5dc4 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.382343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 813/1618] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.384143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65d4a-50b5-4d4e-bfad-cfe992f0075c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.384739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65d4a-50b5-4d4e-bfad-cfe992f0075c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.385288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c65d4a-50b5-4d4e-bfad-cfe992f0075c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.387708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 814/1619] 10.222.0.85 () {54 vars in 962 bytes} [Wed Aug 24 04:53:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:53:45.388682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65d4a-50b5-4d4e-bfad-cfe992f0075c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.410106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c65d4a-50b5-4d4e-bfad-cfe992f0075c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.415649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 806/1620] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:45.417226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.417689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.418115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.418569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.419403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.419917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.420658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.480119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:45.485325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:45.536825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.540147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.556016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 815/1621] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.557031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.576184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f858b1-c13d-41c4-9f3d-b6d794660fc0 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.646657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 807/1622] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:45.656466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.674603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477e81c-9bfa-4e68-9bba-fde5ad3a976f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.691850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.692740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.693177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.693634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.709958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.710424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.717724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.718094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.718922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.721110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.768241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 816/1623] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:45 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:45.772408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.794556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdf182-2501-41cd-b244-fa19d5a8b3b6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.808372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.809270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.809645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.810007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.810752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.813391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.831029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.836132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.839450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 817/1624] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:45.842280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.863053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 808/1625] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:45.863570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7983f2-a2d4-4291-bb90-d623b6b4ff66 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:45.869987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:45.871773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:45.872229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:45.872805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] PATH_INFO: `/v3/projects/671a0a312b9c4f6596614fc534657941/users/0baa36614896471185973630eb71e8fb/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:45.902023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671a0a312b9c4f6596614fc534657941, user_id=0baa36614896471185973630eb71e8fb, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:45.904877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ed4600-4257-4775-95aa-5ab8ab34e096 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:45.935794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 818/1626] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:45 2022] PUT /identity/v3/projects/671a0a312b9c4f6596614fc534657941/users/0baa36614896471185973630eb71e8fb/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:45.938089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:45.966633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da278ca3-73e2-4a67-898a-81b942b1c9cf service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:46.032715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85ca3-5989-4165-b08b-b26ff8ae6359 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.033024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85ca3-5989-4165-b08b-b26ff8ae6359 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.033355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad85ca3-5989-4165-b08b-b26ff8ae6359 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.036674 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 819/1627] 10.222.0.85 () {54 vars in 912 bytes} [Wed Aug 24 04:53:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:53:46.044335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.044475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.046289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.086163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:46.090513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:46.096244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:46.097150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.097653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.098346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.099582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:46.101462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:46.119240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 809/1628] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:53:46.123208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:46.143562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61502f50-7c16-4e7a-9e3e-08845f030a44 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:46.151022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:46.152196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.152688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.153425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] PATH_INFO: `/v3/projects/671a0a312b9c4f6596614fc534657941/users/0baa36614896471185973630eb71e8fb/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.156466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:46.157812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=671a0a312b9c4f6596614fc534657941, user_id=0baa36614896471185973630eb71e8fb, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:46.162622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c32be7-b864-4958-8792-e81f63d205b8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:46.170096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:46.205793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 810/1629] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:46 2022] PUT /identity/v3/projects/671a0a312b9c4f6596614fc534657941/users/0baa36614896471185973630eb71e8fb/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:53:46.207860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d3ee-25bd-4bbd-adff-541a5bdd2ff6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.208465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d3ee-25bd-4bbd-adff-541a5bdd2ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.212014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74d3ee-25bd-4bbd-adff-541a5bdd2ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.260086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 820/1630] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:46.335987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:46.336851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ca74d3ee-25bd-4bbd-adff-541a5bdd2ff6 None None] MFA Rules not processed for user `0baa36614896471185973630eb71e8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:46.336851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ca74d3ee-25bd-4bbd-adff-541a5bdd2ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:46.493872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d5b64-7e6b-44e1-b7f3-22b11cdf05b4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:46.495816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 811/1631] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:46.508810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72cf86-a545-4389-8809-113de4869176 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.509155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72cf86-a545-4389-8809-113de4869176 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.509445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72cf86-a545-4389-8809-113de4869176 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.511023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 812/1632] 10.222.0.85 () {54 vars in 912 bytes} [Wed Aug 24 04:53:46 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:53:46.511607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72cf86-a545-4389-8809-113de4869176 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:46.608757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:46.611249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.611744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.612176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.626981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72cf86-a545-4389-8809-113de4869176 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:46.631095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:46.631740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.632100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.632315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.644149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:46.645697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7bd77e-3508-4990-a22b-7700ed2a1dfc service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:46.669996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 813/1633] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:46.671866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.672157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.672432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.713581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:46.715353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:46.754128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:46.758601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:46.795107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 821/1634] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:53:46.849834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:46.860347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dfab65-2224-42bb-8846-07c2952d93c8 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:46.866371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 814/1635] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:53:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:46.876941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:46.878166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:46.878468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:46.878751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:46.907232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:46.964670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:46.966885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:46.982191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 822/1636] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:53:47.384846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:47.401998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba86eb0-5b8f-46ec-907d-a8c51fac1c78 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:47.424393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:47.424900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:47.425177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:47.425466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:47.494211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:47.498821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b51d45-2a20-49e3-b727-952e7ca85c02 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:47.521171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 815/1637] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:47.919204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:48.059155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19bf589-d9c0-4d2c-b843-f9b4fc85a376 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:48.066372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:48.067004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:48.067902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:48.068286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] PATH_INFO: `/v3/users/dca8e4596495412aa468e661d45756e9` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:48.072074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca8e4596495412aa468e661d45756e9)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:48.082245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: WARNING py.warnings [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:48.082245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: warnings.warn(msg) Aug 24 04:53:48.082245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: Aug 24 04:53:48.085702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:48.289141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca8e4596495412aa468e661d45756e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:48.290219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca8e4596495412aa468e661d45756e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:48.291329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca8e4596495412aa468e661d45756e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:48.307495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca8e4596495412aa468e661d45756e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:48.318918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca8e4596495412aa468e661d45756e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:48.388155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2d1-db3b-4efe-a563-5117af9e9f4c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:48.393242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2d1-db3b-4efe-a563-5117af9e9f4c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:48.393569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7a2d1-db3b-4efe-a563-5117af9e9f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:48.398334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 823/1638] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:53:47 2022] DELETE /identity/v3/users/dca8e4596495412aa468e661d45756e9 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:48.403820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:48.436337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-05b7a2d1-db3b-4efe-a563-5117af9e9f4c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:48.437670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-05b7a2d1-db3b-4efe-a563-5117af9e9f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:48.619957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 816/1639] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:48.683497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:48.688079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:48.784705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:48.811968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df557f13-3e3b-4716-a620-e83e5e24b630 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:48.820675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:48.822250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:48.822591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:48.822875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:48.841335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:48.842892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:48.863595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:48.863875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:48.864157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:48.886893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 824/1640] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:48.912339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] MFA Rules not processed for user `8cb5a1922193425bb974b48d14c915a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:48.914222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:49.050142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.052187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 817/1641] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:49.054356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:49.075584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08767c12-5d81-49d8-80f0-ba62881e9e4c service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.084501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.085614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.086048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.086397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.087204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.091911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:49.204486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 825/1642] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:49 2022] POST /identity/v3/projects => generated 403 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:49.208983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.261873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68727f-5012-4017-a58a-0d5fe3021756 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.392639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.393359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.393536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.393998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.394773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.396970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:49.437835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 818/1643] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:49 2022] POST /identity/v3/users => generated 308 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:49.441975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.462145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1381f77-2917-482c-a976-5aa93b0ca3ea admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.479013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.482189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.482548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.483832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.487234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.489006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:49.528264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 826/1644] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:49.533263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.546189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a8fa4-dc33-401b-8ee1-2fb3d7064f1e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.562297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.563454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.564178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.564451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] PATH_INFO: `/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb/users/2bdab83ceede46598be2b7bb0c98c7de/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.599246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e69c69fbda643e2bba1a35ee19d2bdb, user_id=2bdab83ceede46598be2b7bb0c98c7de, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.610235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:49.627052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:49.663075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 819/1645] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:49 2022] PUT /identity/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb/users/2bdab83ceede46598be2b7bb0c98c7de/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:49.667619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.693330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116da358-8db9-4c9a-8790-b07252e4e62f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.857902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.859570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.859570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.861507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.862207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.866759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:49.906703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 827/1646] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:49.908193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:49.926959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd889-17b1-4da4-af11-a734c962b1c2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:49.945118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:49.945987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:49.946423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:49.947266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] PATH_INFO: `/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb/users/2bdab83ceede46598be2b7bb0c98c7de/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:49.951626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e69c69fbda643e2bba1a35ee19d2bdb, user_id=2bdab83ceede46598be2b7bb0c98c7de, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:49.956181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc14f70a-3e06-4f73-90bb-7876e2bc2e60 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:50.006187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 820/1647] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:49 2022] PUT /identity/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb/users/2bdab83ceede46598be2b7bb0c98c7de/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:50.205785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:50.208143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:50.256244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315ae48-41c5-4163-a651-d7f511c99833 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:50.432639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:50.433079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:50.433410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:50.433755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] PATH_INFO: `/v3/projects/341b3dadd2ef45a184e8d3432476107e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:50.435069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=341b3dadd2ef45a184e8d3432476107e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:50.437643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:50.530676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341b3dadd2ef45a184e8d3432476107e', 'request_id': 'req-e5ea445b-c63c-4d12-87fd-0a129ff631ba'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:50.533962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:50.542034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341b3dadd2ef45a184e8d3432476107e', 'request_id': 'req-e5ea445b-c63c-4d12-87fd-0a129ff631ba'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:50.558821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341b3dadd2ef45a184e8d3432476107e', 'request_id': 'req-e5ea445b-c63c-4d12-87fd-0a129ff631ba'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:50.589936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] The token cache is being invalidate because project 341b3dadd2ef45a184e8d3432476107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:53:50.592454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:50.594298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e5ea445b-c63c-4d12-87fd-0a129ff631ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:50.596531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 828/1648] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:53:50 2022] DELETE /identity/v3/projects/341b3dadd2ef45a184e8d3432476107e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:50.602575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:50.603069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:50.603298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:50.648272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:50.649528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:50.782152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 821/1649] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:50.793543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:50.793806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:50.793900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:50.838845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:50.844652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:50.869850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:50.870391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 829/1650] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:50.888415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3482be23-9369-45b5-9dbf-c3d66bfcf180 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:50.903192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:50.903862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:50.904140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:50.904408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:50.908251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:50.908580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:50.915873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:50.941510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 822/1651] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:53:50.947862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:50.964770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ead8e5-6b84-47b0-9cf6-2b63be03c3a3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:50.980394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:50.980852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:50.981138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:50.981524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:50.982588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:50.984755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:51.063896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 830/1652] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:50 2022] POST /identity/v3/projects => generated 363 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:51.067061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:51.087515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ec0c95-7e89-4341-91f9-7abd5419e06f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:51.225204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:51.225763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.226042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.226316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.227018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:51.229006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:51.264318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:51.272173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 823/1653] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:51 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:51.281290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b527dd-0ddf-478e-a600-bc68bb831ea6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:51.288860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:51.289752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.290036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.290310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.291019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:51.292966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:51.322626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:51.337294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 831/1654] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:51.338641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98038c2b-5fa4-47bf-a564-77d0eba9be08 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:51.354132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:51.354781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.355180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.355854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.358028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:51.361472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b362-6c01-4395-8efa-49c7c74436d7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:51.391793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:51.399222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 824/1655] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:53:51.404950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b5e94-6bed-40be-9ff0-db5f586d10ff admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:51.419344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:51.420405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.420692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.423083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] PATH_INFO: `/v3/projects/e25772ea5feb4b5697e53e6856230386/users/b324e3896b5140b781af2f01c6068673/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.447635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25772ea5feb4b5697e53e6856230386, user_id=b324e3896b5140b781af2f01c6068673, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:51.456541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:51.511496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.511789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.512061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.514755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 832/1656] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:51 2022] PUT /identity/v3/projects/e25772ea5feb4b5697e53e6856230386/users/b324e3896b5140b781af2f01c6068673/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:51.555955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] MFA Rules not processed for user `b324e3896b5140b781af2f01c6068673`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:51.565997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:51.618540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:51.660151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 825/1657] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:51.665113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:51.821662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f85dd4-3836-4bd0-a3a8-0123b9cb5ae6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:51.831082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:51.833667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:51.848528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:51.849043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:51.851333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:51.854620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.055433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.056708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 833/1658] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:51 2022] POST /identity/v3/projects => generated 363 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:52.116160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de505dfb-28b5-4ca1-80d9-224cf3fff089 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.308912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.309550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.309838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.310110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.310766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.313558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.386521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 826/1659] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:52 2022] POST /identity/v3/users => generated 288 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:52.387863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.400680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6200a-2bb0-4880-9726-a8eeb84dbaa5 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.418620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.419264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.419742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.420025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.422990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.424752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.455377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 834/1660] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:52.458937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.470544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f462f00-3836-41bc-97a4-9793b055e27b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.476415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.477378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.477897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.478246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] PATH_INFO: `/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee/users/a23a1c46f2b14a928d0bd88a863a8193/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.515652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0b4596ff345d68bfd6b28f1b583ee, user_id=a23a1c46f2b14a928d0bd88a863a8193, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.519965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.544088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 827/1661] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:52 2022] PUT /identity/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee/users/a23a1c46f2b14a928d0bd88a863a8193/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:52.548076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.569445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200c4c3-df80-4d7c-9f6f-05369870297d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.709418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:52.751070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.751773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.752062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.752339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.753154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.762344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41353dc-2695-4859-b8e0-06101b79c909 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.795506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 835/1662] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:52.797649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:52.818120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a51d5-8354-4149-80dc-d361cdd4ee5d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:52.833525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:52.834442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.834819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.835125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] PATH_INFO: `/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee/users/a23a1c46f2b14a928d0bd88a863a8193/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:52.842712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52c0b4596ff345d68bfd6b28f1b583ee, user_id=a23a1c46f2b14a928d0bd88a863a8193, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:52.846349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:52.893313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 828/1663] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:52 2022] PUT /identity/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee/users/a23a1c46f2b14a928d0bd88a863a8193/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:52.905366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:52.906517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:52.906636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:53.053866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] MFA Rules not processed for user `a23a1c46f2b14a928d0bd88a863a8193`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:53.055147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:53.245532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 836/1664] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:53.255877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:53.260031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:53.522050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d63cc2-8af5-4ffa-b7a7-a56a705b02e9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:53.530148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:53.531631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:53.532095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:53.532657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:53.575673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:53.579888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:53.609146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 829/1665] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:53.861333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:53.894532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794efb6-c601-4239-8bf8-7083b8de848e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:53.909027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:53.909746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:53.910028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:53.910351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:54.063504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:54.065394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab027147-4ad6-40eb-8c43-746889012698 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:54.088476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 837/1666] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:54.394765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:54.397539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:54.535651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:54.619089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a6114-d815-4a24-91ec-d18cc44846f6 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:54.625957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:54.627073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:54.628011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:54.628637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] PATH_INFO: `/v3/users/0d7ec61bcb2c4c318d1b85c9dd61444e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:54.630113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7ec61bcb2c4c318d1b85c9dd61444e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:54.633340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:54.743538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7ec61bcb2c4c318d1b85c9dd61444e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:54.747798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7ec61bcb2c4c318d1b85c9dd61444e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:54.772157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7ec61bcb2c4c318d1b85c9dd61444e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:54.773199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7ec61bcb2c4c318d1b85c9dd61444e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:54.786007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7ec61bcb2c4c318d1b85c9dd61444e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:54.856748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 830/1667] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:53:54 2022] DELETE /identity/v3/users/0d7ec61bcb2c4c318d1b85c9dd61444e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:54.861713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd268a-7aae-4188-8630-c6e0fed6bb43 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:54.862234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd268a-7aae-4188-8630-c6e0fed6bb43 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:54.863017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd268a-7aae-4188-8630-c6e0fed6bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:54.909467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cdbd268a-7aae-4188-8630-c6e0fed6bb43 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:54.910849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cdbd268a-7aae-4188-8630-c6e0fed6bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:55.068437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 838/1668] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:55.277821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:55.279763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:55.431267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d53a1-adb5-41d1-af79-0e986b046d3e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:55.442780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:55.443440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:55.445369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:55.445734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:55.471175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:55.472775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:55.494730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 831/1669] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:56.965183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ebdcd-99cc-4715-b03b-855b60f0579b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:56.965784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ebdcd-99cc-4715-b03b-855b60f0579b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:56.965861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ebdcd-99cc-4715-b03b-855b60f0579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:57.009580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:57.032471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-693ebdcd-99cc-4715-b03b-855b60f0579b None None] MFA Rules not processed for user `2bdab83ceede46598be2b7bb0c98c7de`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:57.034344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-693ebdcd-99cc-4715-b03b-855b60f0579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:57.216142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 839/1670] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:56 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:57.869609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:57.871074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:57.910173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1d617-9cc7-4480-83b6-c62b1b23ddce service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:57.938898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:57.938898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:57.938898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:57.938898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] PATH_INFO: `/v3/projects/00eced53c40d4d9c86be7db0df33a7fb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:57.939626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=00eced53c40d4d9c86be7db0df33a7fb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:57.939626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: WARNING py.warnings [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 04:53:57.939626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: warnings.warn(msg) Aug 24 04:53:57.939626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: Aug 24 04:53:57.939626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:57.940365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c241c-a42c-4c63-99cc-8112a5c76412 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:57.940516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c241c-a42c-4c63-99cc-8112a5c76412 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:57.940769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c241c-a42c-4c63-99cc-8112a5c76412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.020335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3f1c241c-a42c-4c63-99cc-8112a5c76412 None None] MFA Rules not processed for user `5eadf34dc91e4dd79d00a9e218117032`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:58.022521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3f1c241c-a42c-4c63-99cc-8112a5c76412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.088703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00eced53c40d4d9c86be7db0df33a7fb', 'request_id': 'req-61311972-96f8-484e-b7cf-d92dbbcd0abc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:58.112077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:58.124841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00eced53c40d4d9c86be7db0df33a7fb', 'request_id': 'req-61311972-96f8-484e-b7cf-d92dbbcd0abc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:58.169290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00eced53c40d4d9c86be7db0df33a7fb', 'request_id': 'req-61311972-96f8-484e-b7cf-d92dbbcd0abc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:58.199405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] The token cache is being invalidate because project 00eced53c40d4d9c86be7db0df33a7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:53:58.199747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:58.200435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:53:58.202333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 840/1671] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:58.205881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 832/1672] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:53:57 2022] DELETE /identity/v3/projects/00eced53c40d4d9c86be7db0df33a7fb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:58.216760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf472ee-c045-4203-8351-e8e0e1eee290 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.217262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf472ee-c045-4203-8351-e8e0e1eee290 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.217412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:58.217986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf472ee-c045-4203-8351-e8e0e1eee290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.228927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.293067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6bf472ee-c045-4203-8351-e8e0e1eee290 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:58.294655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6bf472ee-c045-4203-8351-e8e0e1eee290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.520029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61311972-96f8-484e-b7cf-d92dbbcd0abc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:58.535062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 841/1673] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:58.542129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:58.542779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.543077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.543360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.544196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.544631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.545375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.549314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.607044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:58.610554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:58.635633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 842/1674] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:58.640049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:58.663888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c254a8-0fa9-4a80-bf2b-6736bba4b98a None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:58.679900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:58.684024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.684583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.684875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.688001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:53:58.688325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:58.691089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:58.754605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 843/1675] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:53:58.759254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:58.780149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:58.783353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:58.790032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:58.796903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8faf9b-b021-4f2d-89fb-f4769959e9b0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:58.801320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 833/1676] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:53:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:53:58.811169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:58.813766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:58.814323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:58.815116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:58.816800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:58.824731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:58.950845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 844/1677] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:58 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:53:58.958096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:58.974667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55affb5a-0700-4e53-ac47-bd6e54afc9bb service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.116628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.117628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.118159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.118629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.119802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.122426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.164835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 834/1678] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:58 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:59.170291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.188817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc7e96-d4ed-4849-9ffe-8c6d0392fc20 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.196809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.197799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.198275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.198742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.201272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.205757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.227967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.242499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 845/1679] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:59.245159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cba498-fe5c-4fe3-9c80-de25d3c0d729 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.254322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.255270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.255849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.256336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.257609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.259848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508caaa-7bb4-4916-9c95-8854f150bc98 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.262142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:53:59.278084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.284843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 835/1680] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:59.294051 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f6431-35a4-4757-9cbd-28621f2546f8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.301583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.302817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.303331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.303829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] PATH_INFO: `/v3/projects/024e1cf4c41b4c258e3dc1dc2b317472/users/e4ea71feb62d42efae048e6af515017b/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.334057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=024e1cf4c41b4c258e3dc1dc2b317472, user_id=e4ea71feb62d42efae048e6af515017b, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.338579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.395279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.395832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.396280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.401152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 846/1681] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:59 2022] PUT /identity/v3/projects/024e1cf4c41b4c258e3dc1dc2b317472/users/e4ea71feb62d42efae048e6af515017b/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:53:59.434560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] MFA Rules not processed for user `e4ea71feb62d42efae048e6af515017b`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:53:59.436031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:53:59.565077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 836/1682] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:53:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:53:59.566500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.665526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290dbcb-afbb-45d9-9c7e-ed1d744fcbaf admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.673539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.674417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.674798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.675172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.675967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.678055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.743445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.764745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 847/1683] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:53:59 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:53:59.771249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efd84f-44de-4fe7-b5de-eac3418be717 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.859610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.860549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.861086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.861587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.862311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.864462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.907753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.922365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 837/1684] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:53:59 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:53:59.923907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1145-44d8-40e8-a11f-fa0fc57b688d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:53:59.929863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:53:59.930920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:53:59.931207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:53:59.931872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:53:59.938228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:53:59.940071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:53:59.965038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:53:59.976836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 848/1685] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:53:59.980097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925d7b8-c65e-4254-9846-4392c1df5f14 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:00.003440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:00.004234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.004659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.005004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] PATH_INFO: `/v3/projects/57cb838acc4547618dacc598e55e7426/users/70e3ef9520d2484289b174b62d8f89dc/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.039167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cb838acc4547618dacc598e55e7426, user_id=70e3ef9520d2484289b174b62d8f89dc, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:00.072900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea05ec-877a-4af1-a0b0-9fe4402aa1bb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:00.114399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 838/1686] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:53:59 2022] PUT /identity/v3/projects/57cb838acc4547618dacc598e55e7426/users/70e3ef9520d2484289b174b62d8f89dc/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:00.115076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:00.130468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f807e51-2133-40af-83f4-a5319a1d6d56 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:00.190977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87ee2-c812-4250-bdc7-eb7b1b343491 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.191657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87ee2-c812-4250-bdc7-eb7b1b343491 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.192181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b87ee2-c812-4250-bdc7-eb7b1b343491 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.200555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 839/1687] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:54:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:54:00.306584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c1a2-10ad-4bbc-8b9f-046d2daf0ecb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.306878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c1a2-10ad-4bbc-8b9f-046d2daf0ecb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.307317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c1a2-10ad-4bbc-8b9f-046d2daf0ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.364808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a3c9c1a2-10ad-4bbc-8b9f-046d2daf0ecb None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:00.368324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a3c9c1a2-10ad-4bbc-8b9f-046d2daf0ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:00.387346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:00.391393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.391852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.394510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.396562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:00.402304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:00.437130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 849/1688] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:00.443314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:00.489812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9af7a-c072-49ef-8bbb-450b36b2c251 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:00.506251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:00.507331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.507722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.508102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] PATH_INFO: `/v3/projects/57cb838acc4547618dacc598e55e7426/users/70e3ef9520d2484289b174b62d8f89dc/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.510894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:00.513206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=57cb838acc4547618dacc598e55e7426, user_id=70e3ef9520d2484289b174b62d8f89dc, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:00.516266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648de312-9883-43f4-8092-a407f72341fb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:00.539760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 850/1689] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:00 2022] PUT /identity/v3/projects/57cb838acc4547618dacc598e55e7426/users/70e3ef9520d2484289b174b62d8f89dc/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:00.553031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.553266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.553549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.564353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 840/1690] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:00.583733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab45-cd82-4cb8-be27-14d92f01f16f None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.584249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab45-cd82-4cb8-be27-14d92f01f16f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.584859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66ab45-cd82-4cb8-be27-14d92f01f16f None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.586652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 841/1691] 10.222.0.85 () {54 vars in 961 bytes} [Wed Aug 24 04:54:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:54:00.595990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.596397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.596822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:00.597747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.636610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:00.644025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] MFA Rules not processed for user `70e3ef9520d2484289b174b62d8f89dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:00.644488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:00.645387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:00.800703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 851/1692] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:00.814539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:00.816019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:00.827327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 842/1693] 10.222.0.85 () {58 vars in 1058 bytes} [Wed Aug 24 04:54:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:00.838999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:00.857518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0793dcac-fbd9-4982-b9f0-6fc99d35e243 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:00.871162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:00.871888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.872067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.872559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.897082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:00.900366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:00.933296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 843/1694] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:00.941196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e203f-5a21-4ce2-89ae-c7b7adb97c33 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:00.946343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:00.947295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:00.947734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:00.948299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:00.965534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:00.975512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3724078-18a8-4f9e-b954-1c63768fc782 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.004191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 852/1695] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:00 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:01.102026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.120775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9ce82-851f-4c31-aa96-62bdaebea162 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.127493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.128679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.129062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.129532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.260865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.262663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3f0c8-6f12-4d82-b4a1-a60d0c239ba7 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.301519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 844/1696] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:01.561002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.561639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.561639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.596091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] MFA Rules not processed for user `e87c835bd666445a826bd7e7871023c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:01.597554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.716034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 853/1697] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:01.717242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f796f-f590-40c4-a859-76cc2e460ea6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.717713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f796f-f590-40c4-a859-76cc2e460ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.718159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3f796f-f590-40c4-a859-76cc2e460ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.759225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-0d3f796f-f590-40c4-a859-76cc2e460ea6 None None] MFA Rules not processed for user `e87c835bd666445a826bd7e7871023c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:01.759735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0d3f796f-f590-40c4-a859-76cc2e460ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.783249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 845/1698] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:01.799117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:01.801001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:01.840299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:01.947833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e829018-9d1b-4790-a65c-82bcae6e3f50 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:01.963864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:01.965215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:01.965507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:01.965780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:01.978993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:01.980653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2884b-f63c-4ad2-ac95-74fd3f5d79cb service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:01.991676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 854/1699] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:03.025147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5577ed-1c4e-4891-a7f0-ade50d60fea5 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.025581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5577ed-1c4e-4891-a7f0-ade50d60fea5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.025812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5577ed-1c4e-4891-a7f0-ade50d60fea5 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.027384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 846/1700] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:54:03.077773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297a8f-53c4-42c5-950b-ed8ad5034007 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.078499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297a8f-53c4-42c5-950b-ed8ad5034007 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.078499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297a8f-53c4-42c5-950b-ed8ad5034007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.131621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-71297a8f-53c4-42c5-950b-ed8ad5034007 None None] MFA Rules not processed for user `f1af6c98265e44eab90317693fb7f1b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:03.133063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-71297a8f-53c4-42c5-950b-ed8ad5034007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:03.167037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 855/1701] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:54:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:03.402322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5577ed-1c4e-4891-a7f0-ade50d60fea5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:03.428737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5577ed-1c4e-4891-a7f0-ade50d60fea5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:03.443115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:03.444001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.444443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.445259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.470951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:03.477085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:03.498427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d95d4-90a6-45bb-b8ea-d6d7b33028f9 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.498724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d95d4-90a6-45bb-b8ea-d6d7b33028f9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.499659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d95d4-90a6-45bb-b8ea-d6d7b33028f9 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.501591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 856/1702] 10.222.0.85 () {54 vars in 912 bytes} [Wed Aug 24 04:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:54:03.507081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.507366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.507676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.540639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 847/1703] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:03.593486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:03.595174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:03.645939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:03.649943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:03.735338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:03.774013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb44c29c-41f7-4d9c-a820-b46686d81c77 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:03.788246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:03.788982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.789337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.791168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] PATH_INFO: `/v3/users/8cb5a1922193425bb974b48d14c915a7` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.793204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb5a1922193425bb974b48d14c915a7)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:03.798850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:03.856013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 857/1704] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:54:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:03.879735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:03.886217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:03.903971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bb19-8652-462e-b3f4-e49ff876184e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:03.915567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:03.918212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:03.918465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:03.919994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:03.923170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb5a1922193425bb974b48d14c915a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:03.925124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb5a1922193425bb974b48d14c915a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:03.945739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:03.950887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:03.957637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb5a1922193425bb974b48d14c915a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:03.959855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb5a1922193425bb974b48d14c915a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:03.977073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 858/1705] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:03.984164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-24fdfa64-5e34-4655-b67b-4c12ee2feffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb5a1922193425bb974b48d14c915a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.059139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 848/1706] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:03 2022] DELETE /identity/v3/users/8cb5a1922193425bb974b48d14c915a7 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:04.260210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:04.261591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:04.296578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487f3bf6-577a-4596-b850-8a4f8b32fd38 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:04.443173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:04.443847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:04.444124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:04.444477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] PATH_INFO: `/v3/users/b324e3896b5140b781af2f01c6068673` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:04.448846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b324e3896b5140b781af2f01c6068673)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:04.450830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:04.534267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:04.571819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dce5-71c9-48c1-a414-efac477494c1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:04.573051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dce5-71c9-48c1-a414-efac477494c1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:04.573532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946dce5-71c9-48c1-a414-efac477494c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:04.578286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b324e3896b5140b781af2f01c6068673'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.578997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b324e3896b5140b781af2f01c6068673'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.580091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b324e3896b5140b781af2f01c6068673'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.597633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b324e3896b5140b781af2f01c6068673'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.625774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e54f6e8c-0da0-4958-9d7e-a2f3b8348a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b324e3896b5140b781af2f01c6068673'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:04.629070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d946dce5-71c9-48c1-a414-efac477494c1 None None] MFA Rules not processed for user `9d247454fd674803ba080bb60ac2f645`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:04.630798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d946dce5-71c9-48c1-a414-efac477494c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:04.667526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 859/1707] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:04 2022] DELETE /identity/v3/users/b324e3896b5140b781af2f01c6068673 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:04.673142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:04.673418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:04.673698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:04.734467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 849/1708] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:04.745821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:04.746372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:04.746873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:04.755278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:04.756589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:04.784552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] MFA Rules not processed for user `9d247454fd674803ba080bb60ac2f645`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:04.788134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:04.966565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 850/1709] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:04.973112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 860/1710] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:04.988449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:04.992417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:05.007248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:05.087426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:05.089174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:05.132387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0c6d5-5a67-4d58-9c43-2a010c78ee56 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:05.144852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:05.146040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:05.146424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:05.146906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:05.157942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:05.159770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:05.188475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 851/1711] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:05.309697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf28e4-c2f5-4262-8bf2-a9cf4486f296 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:05.317357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:05.318340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:05.319251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:05.319876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:05.350428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:05.352876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42891925-9c93-43bd-8766-332c288657d3 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:05.368186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 861/1712] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:05.953078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:05.955098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.049930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389d392-977b-44aa-b734-7449665e4d9d service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:06.057704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:06.058476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:06.058953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:06.059718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:06.062337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.081417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:06.083558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:06.112568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 852/1713] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:06.134235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334a10-9e28-40c6-806b-a20e8f947afb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:06.136663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334a10-9e28-40c6-806b-a20e8f947afb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:06.137077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09334a10-9e28-40c6-806b-a20e8f947afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:06.145400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:06.148488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.186000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-09334a10-9e28-40c6-806b-a20e8f947afb None None] MFA Rules not processed for user `e87c835bd666445a826bd7e7871023c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:06.188334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-09334a10-9e28-40c6-806b-a20e8f947afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.193996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735d84a-1ad4-4f38-97c2-8ef72b48ea04 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:06.211698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:06.217228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:06.218228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:06.219921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] PATH_INFO: `/v3/projects/240606ab940649ae9e8193af6f958cda` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:06.222963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=240606ab940649ae9e8193af6f958cda)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:06.228598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:06.310417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.358355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 862/1714] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:06.359888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a65-ad6d-4a85-8e1b-8571e14bd872 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:06.360174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a65-ad6d-4a85-8e1b-8571e14bd872 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:06.360450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01573a65-ad6d-4a85-8e1b-8571e14bd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:06.417649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-01573a65-ad6d-4a85-8e1b-8571e14bd872 None None] MFA Rules not processed for user `5eadf34dc91e4dd79d00a9e218117032`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:06.422278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-01573a65-ad6d-4a85-8e1b-8571e14bd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.453072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240606ab940649ae9e8193af6f958cda', 'request_id': 'req-740bd58e-0560-4ba1-8391-bcdf51ceb83e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.471202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240606ab940649ae9e8193af6f958cda', 'request_id': 'req-740bd58e-0560-4ba1-8391-bcdf51ceb83e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.497766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240606ab940649ae9e8193af6f958cda', 'request_id': 'req-740bd58e-0560-4ba1-8391-bcdf51ceb83e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.520302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:06.538590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] The token cache is being invalidate because project 240606ab940649ae9e8193af6f958cda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:06.540557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.541950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.552935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 853/1715] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:06 2022] DELETE /identity/v3/projects/240606ab940649ae9e8193af6f958cda => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:06.556265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:06.559656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:06.588417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 863/1716] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:06.790691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740bd58e-0560-4ba1-8391-bcdf51ceb83e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:06.814791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:06.818572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:06.820318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:06.821142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] PATH_INFO: `/v3/users/2bdab83ceede46598be2b7bb0c98c7de` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:06.826055 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdab83ceede46598be2b7bb0c98c7de)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:06.830422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:06.961676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdab83ceede46598be2b7bb0c98c7de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.962292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdab83ceede46598be2b7bb0c98c7de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.989338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdab83ceede46598be2b7bb0c98c7de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:06.990141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdab83ceede46598be2b7bb0c98c7de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:07.035033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdab83ceede46598be2b7bb0c98c7de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:07.039703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf81c-7ab9-4532-b92f-dfe966cc790e None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:07.040204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf81c-7ab9-4532-b92f-dfe966cc790e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:07.040443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf81c-7ab9-4532-b92f-dfe966cc790e None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:07.043121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 864/1717] 10.222.0.85 () {54 vars in 912 bytes} [Wed Aug 24 04:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:54:07.063514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:07.065500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:07.065500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:07.103105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 854/1718] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:06 2022] DELETE /identity/v3/users/2bdab83ceede46598be2b7bb0c98c7de => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:07.146047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:07.151520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:07.359924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 865/1719] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:54:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:07.437615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:07.448031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:07.527892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ccec9-6036-49ec-a5e8-f095655c8192 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:07.557407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:07.563065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:07.565618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:07.577673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:07.619006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:07.648211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:07.701193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 855/1720] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:07.895221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:07.896842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:08.106318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e2a9cc-60cc-401b-ba55-333eefe21942 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:08.119253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:08.121909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:08.122844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:08.124791 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] PATH_INFO: `/v3/projects/e25772ea5feb4b5697e53e6856230386` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:08.128606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25772ea5feb4b5697e53e6856230386)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:08.136259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:08.325707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:08.332810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25772ea5feb4b5697e53e6856230386', 'request_id': 'req-aae85fa9-a188-4c91-a96e-322d09408df4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.357606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:08.358194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25772ea5feb4b5697e53e6856230386', 'request_id': 'req-aae85fa9-a188-4c91-a96e-322d09408df4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.359947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:08.392638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25772ea5feb4b5697e53e6856230386', 'request_id': 'req-aae85fa9-a188-4c91-a96e-322d09408df4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.427186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] The token cache is being invalidate because project e25772ea5feb4b5697e53e6856230386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:08.428867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.430349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3a8e9-ebcf-4cf5-83b5-9423d2949d99 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:08.431412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.438693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 866/1721] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:07 2022] DELETE /identity/v3/projects/e25772ea5feb4b5697e53e6856230386 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:08.441313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:08.444928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:08.543858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:08.554714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:08.555004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:08.556901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] PATH_INFO: `/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:08.560775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e69c69fbda643e2bba1a35ee19d2bdb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:08.563807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:08.595414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:08.680599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae85fa9-a188-4c91-a96e-322d09408df4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:08.726113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e69c69fbda643e2bba1a35ee19d2bdb', 'request_id': 'req-51ae7aab-9773-4eb3-b21e-90c9c8031403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.737894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e69c69fbda643e2bba1a35ee19d2bdb', 'request_id': 'req-51ae7aab-9773-4eb3-b21e-90c9c8031403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.772694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e69c69fbda643e2bba1a35ee19d2bdb', 'request_id': 'req-51ae7aab-9773-4eb3-b21e-90c9c8031403'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.816081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] The token cache is being invalidate because project 3e69c69fbda643e2bba1a35ee19d2bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:08.816380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.818118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-51ae7aab-9773-4eb3-b21e-90c9c8031403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:08.820874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 856/1722] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:08 2022] DELETE /identity/v3/projects/3e69c69fbda643e2bba1a35ee19d2bdb => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:08.825499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2ac8-e4a5-4464-80b4-abd767f4b74c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:08.825795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2ac8-e4a5-4464-80b4-abd767f4b74c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:08.826076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2ac8-e4a5-4464-80b4-abd767f4b74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:08.888344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:08.889005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:08.889356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:08.889748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] PATH_INFO: `/v3/users/a23a1c46f2b14a928d0bd88a863a8193` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:08.894112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a23a1c46f2b14a928d0bd88a863a8193)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:08.896041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:08.900752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-90bf2ac8-e4a5-4464-80b4-abd767f4b74c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:08.902024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-90bf2ac8-e4a5-4464-80b4-abd767f4b74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:08.968611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 857/1723] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:08.976366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:08.976668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:08.976949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:09.029036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:09.031175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:09.060137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 858/1724] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:09.064646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:09.072825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a23a1c46f2b14a928d0bd88a863a8193'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:09.073842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a23a1c46f2b14a928d0bd88a863a8193'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:09.074871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a23a1c46f2b14a928d0bd88a863a8193'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:09.105694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c42e0-b183-4258-8147-03542f39f9ca None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:09.113558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a23a1c46f2b14a928d0bd88a863a8193'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:09.137801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a23a1c46f2b14a928d0bd88a863a8193'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:09.140585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:09.141235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:09.141508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:09.141781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:09.142454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:09.142758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:09.148376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:09.180601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 867/1725] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:08 2022] DELETE /identity/v3/users/a23a1c46f2b14a928d0bd88a863a8193 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:09.209809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 859/1726] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:09.214262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:09.216183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:09.224093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:09.436984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d638-a9f4-4c47-9ffc-e60918bd8a1b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:09.463052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:09.464183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:09.467070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:09.470290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:09.471211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:09.479966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:09.575942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 868/1727] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:09 2022] POST /identity/v3/projects => generated 379 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:09.580348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:09.601352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb93e5-d94f-4b39-996f-c9dc1fdbfaa5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:09.882769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:09.883417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:09.883711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:09.883994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:09.884633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:09.886561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:09.986640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 860/1728] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:09 2022] POST /identity/v3/users => generated 290 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:09.987676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:10.005253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108de798-0e21-4e62-be8e-6a66a5c220fc admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:10.016288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:10.017326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.017832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.018465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.019627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:10.022494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61657a67-6d53-40bb-adc6-6c967e23a683 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:10.047563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 869/1729] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:10.049212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:10.067269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8f2ec-a1c7-42dc-8eb4-1fcb0c04ff7c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:10.097977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:10.098744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.099182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.099666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.100552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:10.103493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:10.180522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.180834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.181066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.219361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 861/1730] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:10.223378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:10.224625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] MFA Rules not processed for user `7da49f610a644878bd319fea57b1b5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:10.227166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:10.263310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943d0fd-ce96-4ddf-9972-c5b428186561 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:10.287340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:10.290202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.292091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.292726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] PATH_INFO: `/v3/projects/497c5fb9a1e147a182b792ae87374e08/users/ca8eb04937ab4cafbf3d748e3ff50aa6/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.333688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=497c5fb9a1e147a182b792ae87374e08, user_id=ca8eb04937ab4cafbf3d748e3ff50aa6, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:10.341002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48d37-f69f-4f43-abf7-9677572a6d66 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:10.375520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 862/1731] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:10 2022] PUT /identity/v3/projects/497c5fb9a1e147a182b792ae87374e08/users/ca8eb04937ab4cafbf3d748e3ff50aa6/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:10.383876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.385038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.385508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.401057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 870/1732] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:10.412200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:10.414523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:10.465491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] MFA Rules not processed for user `ca8eb04937ab4cafbf3d748e3ff50aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:10.466750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:10.485154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:10.690935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 863/1733] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:10.695160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:10.823019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db932f-e29f-46e1-994f-420b438a5c0f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:10.829273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:10.830071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.830583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.831578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.832504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:10.834855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d8ecb5-6e51-4c12-8bb5-10c697e9a471 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:10.879688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 864/1734] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:10 2022] POST /identity/v3/projects => generated 377 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:10.879688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:10.879688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:10.879688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:10.946777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:10.977583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b284fd-c978-4dde-8826-3fca8e89fc59 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:10.982315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:10.983891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:11.113696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 865/1735] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:54:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:11.115358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:11.183797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:11.276735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9484824-713f-4cde-a907-d9907cd00a47 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:11.285247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:11.286638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:11.287198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:11.287697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:11.288477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:11.291182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:11.297630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:11.298266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:11.298543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:11.298813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:11.350431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 866/1736] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:11 2022] POST /identity/v3/users => generated 295 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:11.351723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:11.354367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:11.433120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba586d-b391-4d45-bc6c-043899ec6560 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:11.469746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:11.470998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:11.471287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:11.471596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] PATH_INFO: `/v3/users/e4ea71feb62d42efae048e6af515017b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:11.473376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ea71feb62d42efae048e6af515017b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:11.480674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:11.532019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:11.533728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:11.601470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 871/1737] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:11.602830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:11.616050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ea71feb62d42efae048e6af515017b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:11.621154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ea71feb62d42efae048e6af515017b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:11.647753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ea71feb62d42efae048e6af515017b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:11.649331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ea71feb62d42efae048e6af515017b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:11.655634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832c0f-da50-4812-a9e3-685a7f89cb54 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:11.665137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ea71feb62d42efae048e6af515017b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:11.672583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:11.673378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:11.673761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:11.675970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:11.676801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:11.679500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:11.705923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 867/1738] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:11 2022] DELETE /identity/v3/users/e4ea71feb62d42efae048e6af515017b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:11.713398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:11.720723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:11.725466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 872/1739] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:11.726430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:11.736037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:11.941729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8e64-d867-4fd4-a081-e9776f8fddc8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:11.985094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:12.034391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd696ee-ec6b-4708-b1cc-ef4e952e7ba9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:12.050406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:12.050406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.050406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.050406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] PATH_INFO: `/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.057090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52c0b4596ff345d68bfd6b28f1b583ee)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:12.063594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:12.094929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:12.146155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:12.146792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.147360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.147884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.161971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.192898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52c0b4596ff345d68bfd6b28f1b583ee', 'request_id': 'req-16a0dbff-a15c-4d91-9312-e3784000d120'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:12.222023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52c0b4596ff345d68bfd6b28f1b583ee', 'request_id': 'req-16a0dbff-a15c-4d91-9312-e3784000d120'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:12.256176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52c0b4596ff345d68bfd6b28f1b583ee', 'request_id': 'req-16a0dbff-a15c-4d91-9312-e3784000d120'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:12.284399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] The token cache is being invalidate because project 52c0b4596ff345d68bfd6b28f1b583ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:12.284399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:12.285425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-16a0dbff-a15c-4d91-9312-e3784000d120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:12.286964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 868/1740] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:11 2022] DELETE /identity/v3/projects/52c0b4596ff345d68bfd6b28f1b583ee => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:12.288252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2462a0-34e7-485c-b3bd-79d4c83c28fb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.288529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2462a0-34e7-485c-b3bd-79d4c83c28fb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.288934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2462a0-34e7-485c-b3bd-79d4c83c28fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.338085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2a2462a0-34e7-485c-b3bd-79d4c83c28fb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:12.341304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2a2462a0-34e7-485c-b3bd-79d4c83c28fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.351199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:12.352866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:12.376155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 873/1741] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:54:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:54:12.379053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:12.383281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.431552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d482eba-3fc6-44d5-b44a-912e6791c987 service swift] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:12.585970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 869/1742] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:12.585970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c23c-0eb5-4ee5-974a-de3095969ee4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.585970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c23c-0eb5-4ee5-974a-de3095969ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.585970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1c23c-0eb5-4ee5-974a-de3095969ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.621507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:12.622297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.622735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.623168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] PATH_INFO: `/v3/projects/e195787110a64e63bf841822f7607bd6/users/46d68e2e3a5b41fb9b3355315feec299/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.650982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-74d1c23c-0eb5-4ee5-974a-de3095969ee4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:12.652392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-74d1c23c-0eb5-4ee5-974a-de3095969ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.663755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e195787110a64e63bf841822f7607bd6, user_id=46d68e2e3a5b41fb9b3355315feec299, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:12.682109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:12.698855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 870/1743] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:12.703373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.705186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.705505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.712296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 874/1744] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:12 2022] PUT /identity/v3/projects/e195787110a64e63bf841822f7607bd6/users/46d68e2e3a5b41fb9b3355315feec299/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:12.717691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:12.725875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.774211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:12.777139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:12.822638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:12.884125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c3e8e-d724-46f5-88e5-8f402d1e7fd5 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:12.902468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:12.903150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:12.903430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:12.903734 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:12.904423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:12.907139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:12.938158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 875/1745] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:12 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:12.939813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:12.953939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:13.000511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 871/1746] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:13.003198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:13.023555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29ff62-b573-4612-838a-a0094af465b6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:13.045166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:13.047865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.049486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.049926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] PATH_INFO: `/v3/projects/e195787110a64e63bf841822f7607bd6/users/46d68e2e3a5b41fb9b3355315feec299/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.057163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e195787110a64e63bf841822f7607bd6, user_id=46d68e2e3a5b41fb9b3355315feec299, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:13.065464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:13.117726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 872/1747] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:13 2022] PUT /identity/v3/projects/e195787110a64e63bf841822f7607bd6/users/46d68e2e3a5b41fb9b3355315feec299/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:13.121615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:13.224683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484833b-c838-4a48-b83f-c2dd5d4aa41b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:13.270560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:13.415870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b3001-4991-4d44-a3c0-fa5523163f3a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:13.422521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:13.423151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.423490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.436818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.437624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:13.437937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:13.455419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea7245-9285-45fa-bb03-c29c2f24a7c2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:13.481168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:13.481896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.482260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.482616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.528468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:13.537169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:13.553888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 873/1748] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:13.562614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.562935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.563217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.587779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 876/1749] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:13.589616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:13.623193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f3d3-1abb-41c1-912d-67e32be0a108 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:13.638641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:13.639232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.641718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.642019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.642739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:13.648453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:13.679255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] MFA Rules not processed for user `46d68e2e3a5b41fb9b3355315feec299`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:13.680893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:13.721578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 877/1750] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:13 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:13.732158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:13.805226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 874/1751] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:13.816706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:13.818672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:13.959072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0475c5-3ef4-46c9-96f2-5322a0eda0c6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:13.974204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:13.974847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:13.975204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:13.975706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:13.976495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:13.982629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:14.021048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:14.022694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a6738-ea2d-4bcf-8923-0f9df387f367 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:14.031528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 878/1752] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:13 2022] POST /identity/v3/users => generated 283 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:14.036125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:14.065445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96504d-2ed2-4bc8-8237-953c32e68843 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:14.081382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:14.082014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.082298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.082755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.083707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:14.085490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:14.116939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 879/1753] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:14.119937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:14.151024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259dc0d0-f402-4d9b-a80e-71ea233767fc admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:14.197289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:14.197289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.197289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.197289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.197719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:14.197719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:14.199816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:14.202371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.203036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.203767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.213746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:14.222545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 880/1754] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:14 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:14.224005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:14.252807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388182a4-bcf0-460b-9987-b4ce9fec3c05 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:14.255693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:14.267178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:14.267905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.271210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.271513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] PATH_INFO: `/v3/projects/47ee60e82db24df78f3beee6905de40f/users/3e803a3654c840b6a8a8363e8e146726/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.309997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=47ee60e82db24df78f3beee6905de40f, user_id=3e803a3654c840b6a8a8363e8e146726, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:14.317162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a184b-f157-4847-ad51-acdc0ac4ad1c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:14.345242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 881/1755] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:14 2022] PUT /identity/v3/projects/47ee60e82db24df78f3beee6905de40f/users/3e803a3654c840b6a8a8363e8e146726/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:14.357364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.358228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.358462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.429405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:14.429840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] MFA Rules not processed for user `3e803a3654c840b6a8a8363e8e146726`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:14.431148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:14.431841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e857786-943d-46c7-835a-707046f3a487 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:14.461584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 875/1756] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:14.558949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.560011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.560411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.681402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 882/1757] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:14.685533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:14.689616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:14.697718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:14.884897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 876/1758] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 04:54:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:14.932137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7d73f-9a7f-48e1-ba17-090886d9f16c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:14.943126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:14.945399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:14.945765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:14.946725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:14.951936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:14.957391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.026962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 883/1759] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:14 2022] POST /identity/v3/projects => generated 365 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:15.032005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:15.083912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a6375-d835-4930-85b3-5df82d6b59e0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:15.085247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:15.087284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:15.231416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:15.312012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:15.314514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:15.315053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:15.316015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:15.320033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:15.321367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619c34f-e5cb-4c4e-a136-75c087f3e2e9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:15.324981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.343342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:15.344347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:15.344811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:15.345168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:15.373974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:15.377590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.391632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 877/1760] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:15 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:15.393000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:15.412217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 884/1761] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:15.436088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38768-6d46-41c5-a064-7088e6a45614 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:15.442738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:15.443373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:15.443703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:15.444100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:15.445059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:15.446717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.509472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 878/1762] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:15.511925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:15.540547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb60e4c-829a-422e-8288-e67b6b29590c service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:15.564906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:15.565697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:15.566172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:15.566559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] PATH_INFO: `/v3/projects/546737f8eb824779a96c599eb387ef48/users/f225ee1a9e9f49eeba14e162eea7230d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:15.604522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=546737f8eb824779a96c599eb387ef48, user_id=f225ee1a9e9f49eeba14e162eea7230d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:15.614184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.635191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 885/1763] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:15 2022] PUT /identity/v3/projects/546737f8eb824779a96c599eb387ef48/users/f225ee1a9e9f49eeba14e162eea7230d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:15.639381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:15.653071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0ab8f-6e90-4db9-9488-04b3a0eee635 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:15.812308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:15.885243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:15.886826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:15.887302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:15.887763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:15.888656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:15.891442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc50164-1987-4659-bf29-acec5ccd9620 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:15.985968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 879/1764] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:15.989242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:16.004786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b022192-7abb-4def-9375-2bc4b8adef2a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:16.017659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:16.018473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:16.018828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:16.019161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] PATH_INFO: `/v3/projects/546737f8eb824779a96c599eb387ef48/users/f225ee1a9e9f49eeba14e162eea7230d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:16.022580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=546737f8eb824779a96c599eb387ef48, user_id=f225ee1a9e9f49eeba14e162eea7230d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:16.039628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:16.073969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 886/1765] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:15 2022] PUT /identity/v3/projects/546737f8eb824779a96c599eb387ef48/users/f225ee1a9e9f49eeba14e162eea7230d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:16.085499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:16.085499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:16.086081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:16.160882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] MFA Rules not processed for user `f225ee1a9e9f49eeba14e162eea7230d`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:16.161916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:16.179961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:16.323069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9776819-8d2d-4b71-98e1-e6b63538f83d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:16.331132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:16.332133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:16.332468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:16.332751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:16.339269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 880/1766] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:16.363399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:16.365743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:16.410862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dfe88-fb3e-4b77-a6d1-0acbe384e086 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:16.418342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:16.419287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:16.419768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:16.420814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:16.452717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:16.455526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:16.494433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 881/1767] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:16.505811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:16.509428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:16.553629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 887/1768] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:16.668879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:16.681752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5523ead-8ee8-4ad5-b1d5-0e92799ca218 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:16.730202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:16.733258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:16.734016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:16.735370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:17.044539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:17.046828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:17.085634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:17.087152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:17.104518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 882/1769] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:17.282449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:17.343129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d0f5a0-6b4a-4eba-9322-7fbd22862961 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:17.352192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:17.353062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:17.353579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:17.354447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] PATH_INFO: `/v3/projects/024e1cf4c41b4c258e3dc1dc2b317472` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:17.356197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] RBAC: Authorizing `identity:delete_project(project_id=024e1cf4c41b4c258e3dc1dc2b317472)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:17.363379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:17.541491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '024e1cf4c41b4c258e3dc1dc2b317472', 'request_id': 'req-031080b0-7849-48aa-9f75-aac9face52df'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:17.579184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '024e1cf4c41b4c258e3dc1dc2b317472', 'request_id': 'req-031080b0-7849-48aa-9f75-aac9face52df'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:17.617552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '024e1cf4c41b4c258e3dc1dc2b317472', 'request_id': 'req-031080b0-7849-48aa-9f75-aac9face52df'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:17.650240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] The token cache is being invalidate because project 024e1cf4c41b4c258e3dc1dc2b317472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:17.650547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:17.653135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-031080b0-7849-48aa-9f75-aac9face52df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:17.657587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 888/1770] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:17 2022] DELETE /identity/v3/projects/024e1cf4c41b4c258e3dc1dc2b317472 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:17.664396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:17.696397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ade22-dec0-4e3a-8f35-450457ac4ee9 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:17.917944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:17.956610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:17.957665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:17.957957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:17.958238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] PATH_INFO: `/v3/users/70e3ef9520d2484289b174b62d8f89dc` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:17.973969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e3ef9520d2484289b174b62d8f89dc)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:17.977258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:18.171747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e3ef9520d2484289b174b62d8f89dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:18.173338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e3ef9520d2484289b174b62d8f89dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:18.204279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e3ef9520d2484289b174b62d8f89dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:18.204943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e3ef9520d2484289b174b62d8f89dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:18.218323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8260448e-8e95-4fb8-b104-5a40326d7c0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e3ef9520d2484289b174b62d8f89dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:18.303720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 883/1771] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:17 2022] DELETE /identity/v3/users/70e3ef9520d2484289b174b62d8f89dc => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:19.528486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:19.529079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:19.529168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:19.531610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 889/1772] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:54:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 04:54:19.606474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:19.607361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:19.608395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:19.653582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:19.670931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:19.959695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 884/1773] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:54:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:20.004379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:20.010584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:20.101157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73153cf3-5836-4ca5-b6f4-c12637707601 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:20.111341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:20.111917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:20.112324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:20.112886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:20.133417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:20.135366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:20.151224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 890/1774] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:20.476697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:20.479558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:20.659954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:20.663084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:20.818008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d76fb1-501b-47b9-9b3d-b35682c2ceca None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:20.842551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:20.846184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:20.856276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:20.859762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] PATH_INFO: `/v3/users/ca8eb04937ab4cafbf3d748e3ff50aa6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:20.866059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8eb04937ab4cafbf3d748e3ff50aa6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:20.878225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:20.886827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:20.930497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c966fc7-5f73-4834-9324-8ea11b72c276 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:20.945742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:20.946875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:20.947328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:20.948083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] PATH_INFO: `/v3/users/3e803a3654c840b6a8a8363e8e146726` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:20.953075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e803a3654c840b6a8a8363e8e146726)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:20.955078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:21.084539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8eb04937ab4cafbf3d748e3ff50aa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.085540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8eb04937ab4cafbf3d748e3ff50aa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.103513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8eb04937ab4cafbf3d748e3ff50aa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.105631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8eb04937ab4cafbf3d748e3ff50aa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.123978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e803a3654c840b6a8a8363e8e146726'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.125675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e803a3654c840b6a8a8363e8e146726'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.126659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e803a3654c840b6a8a8363e8e146726'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.129029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e2325a71-dbd1-401e-a8bd-2a77ecebdfff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8eb04937ab4cafbf3d748e3ff50aa6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.142923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e803a3654c840b6a8a8363e8e146726'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.163283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f789c6c0-9a50-4376-a421-f83e37fbcbce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e803a3654c840b6a8a8363e8e146726'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:21.165058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:21.205041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 891/1775] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:20 2022] DELETE /identity/v3/users/3e803a3654c840b6a8a8363e8e146726 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:21.206735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:21.207034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:21.207411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:21.212755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 885/1776] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:20 2022] DELETE /identity/v3/users/ca8eb04937ab4cafbf3d748e3ff50aa6 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:21.217846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:21.218427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:21.219231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:21.247209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:21.253752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:21.255854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:21.258843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:21.415841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 886/1777] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:21.494180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 892/1778] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:21.508771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:21.510410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:21.627516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:21.628985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:21.681372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceac442-8064-4977-b2f8-d7ffa05c81c4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:21.689217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:21.690205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:21.690606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:21.693068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:21.726647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:21.730849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:21.767963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 887/1779] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:21.839263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac682750-847f-4ea5-8570-2f78ad756985 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:21.848786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:21.850906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:21.851425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:21.851726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:21.876912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:21.878373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb543b-481e-4043-9bc1-da45bc865ccb service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:21.901383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 893/1780] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:22.437901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:22.440751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:22.462555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1223877c-52cc-4663-8b56-2145174da8b9 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:22.477147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:22.479440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:22.479906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:22.480350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] PATH_INFO: `/v3/projects/57cb838acc4547618dacc598e55e7426` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:22.485296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57cb838acc4547618dacc598e55e7426)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:22.495977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:22.539612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:22.649991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57cb838acc4547618dacc598e55e7426', 'request_id': 'req-089f590e-6b54-493b-a852-f8f987f61921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:22.664877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57cb838acc4547618dacc598e55e7426', 'request_id': 'req-089f590e-6b54-493b-a852-f8f987f61921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:22.676088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57cb838acc4547618dacc598e55e7426', 'request_id': 'req-089f590e-6b54-493b-a852-f8f987f61921'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:22.705033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] The token cache is being invalidate because project 57cb838acc4547618dacc598e55e7426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:22.705612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:22.706921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-089f590e-6b54-493b-a852-f8f987f61921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:22.709393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 888/1781] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:22 2022] DELETE /identity/v3/projects/57cb838acc4547618dacc598e55e7426 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:22.718422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476670-fd3a-4a19-91cd-b60145c70622 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:22.719003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476670-fd3a-4a19-91cd-b60145c70622 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:22.719265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3476670-fd3a-4a19-91cd-b60145c70622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:22.750750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f3476670-fd3a-4a19-91cd-b60145c70622 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:22.752093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3476670-fd3a-4a19-91cd-b60145c70622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:22.820291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:22.820470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:22.820749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:22.862152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] MFA Rules not processed for user `7da49f610a644878bd319fea57b1b5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:22.863413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:22.927955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 894/1782] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:22.929730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:22.930025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:22.930294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:22.992118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:22.993357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:23.017537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 895/1783] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:23.022793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.038792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcecf5-7a85-470e-9ea2-7ea5591f639c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.043633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 889/1784] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:23.063332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.064840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.065261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.066367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.067182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:23.068631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.070774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.094193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.105319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 896/1785] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:23.113180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7cb416-edd5-4ecf-bc83-760fbca84195 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.120483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.120483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.120483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.120483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.121028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.123841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e42d8-b87d-4894-9b35-255460c5ad02 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.202383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.211624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 890/1786] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:23 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:23.215054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:23.222661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff47f5-300f-4b2c-909e-06f9c0144cf9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.309775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881aa-f3b3-4706-a896-f24bd762a220 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.310011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881aa-f3b3-4706-a896-f24bd762a220 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.310198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90881aa-f3b3-4706-a896-f24bd762a220 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.316715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 891/1787] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:54:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:54:23.349374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.351139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.351885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.352350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.353226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.355332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.380223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f2f8-45f5-42ca-9ec4-73dc827cab9a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.380223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f2f8-45f5-42ca-9ec4-73dc827cab9a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.380223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21f2f8-45f5-42ca-9ec4-73dc827cab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.450217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 897/1788] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:23 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:23.472150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.495421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1f21f2f8-45f5-42ca-9ec4-73dc827cab9a None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:23.504052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1f21f2f8-45f5-42ca-9ec4-73dc827cab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:23.521441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f5272-9feb-4db4-bb5c-b25a2b95c96f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.536308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.537169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.537665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.537989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.540725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.547492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.582962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 898/1789] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:23.584385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.600953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16c997-f480-4ef2-ad72-ef9d48fbcb31 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.611507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.612507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.612507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.612837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.614842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.630942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.653681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 899/1790] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:23.658680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:23.673464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 892/1791] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:54:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:23.675995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b219a-4a59-4f9a-9d8b-97efc70c8e87 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:23.682971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:23.683960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.684625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.685184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] PATH_INFO: `/v3/projects/25797f4c3e46410abaec97dab9ee90f1/users/3df8e2cf8858431e8306cf6bc604df89/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.722919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25797f4c3e46410abaec97dab9ee90f1, user_id=3df8e2cf8858431e8306cf6bc604df89, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:23.725970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:23.759857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 900/1792] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:23 2022] PUT /identity/v3/projects/25797f4c3e46410abaec97dab9ee90f1/users/3df8e2cf8858431e8306cf6bc604df89/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:23.785852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:23.786145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:23.786586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:23.835916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] MFA Rules not processed for user `3df8e2cf8858431e8306cf6bc604df89`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:23.837166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:23.850344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:23.997416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 893/1793] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:24.002813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.145917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53518acf-fc2e-4032-ae81-0d9f1eb50339 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.164748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.165403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.166098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.171197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.172392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.182514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.235149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.236866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.239253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 901/1794] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:24.248871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.276954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4f4cf-05fb-4c6d-ba3a-deccc0ac4df6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.342895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:24.406386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.408064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.408551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.409072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] PATH_INFO: `/v3/projects/47ee60e82db24df78f3beee6905de40f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.410177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ce730-5772-4166-849b-8e41cf1aea62 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.411197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] RBAC: Authorizing `identity:delete_project(project_id=47ee60e82db24df78f3beee6905de40f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.414986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.416647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.417316 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.417861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.418146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.418821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.424133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.467935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 902/1795] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:24 2022] POST /identity/v3/users => generated 295 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:24.469777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.498554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a94742c-29da-45c0-8125-7800d599ea18 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.503830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.506387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.507637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.507951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.508781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.510997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.531519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 903/1796] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:24.535157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.559245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a84912-2384-4db3-8922-8510257b3f39 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:24.587683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47ee60e82db24df78f3beee6905de40f', 'request_id': 'req-b01e8c69-f8a3-497c-8673-accf317b891b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.603175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47ee60e82db24df78f3beee6905de40f', 'request_id': 'req-b01e8c69-f8a3-497c-8673-accf317b891b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.613002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47ee60e82db24df78f3beee6905de40f', 'request_id': 'req-b01e8c69-f8a3-497c-8673-accf317b891b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.648888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] The token cache is being invalidate because project 47ee60e82db24df78f3beee6905de40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:24.649140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.651979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:24.658197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 894/1797] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:24 2022] DELETE /identity/v3/projects/47ee60e82db24df78f3beee6905de40f => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:24.663581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.666054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.718091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:24.718815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:24.719100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:24.720411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] PATH_INFO: `/v3/projects/27c179a7c3374b32a9ddebadaf825a0a/users/b6aa1482fbbf4d24b01d7d792f2ce5c7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:24.744412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c179a7c3374b32a9ddebadaf825a0a, user_id=b6aa1482fbbf4d24b01d7d792f2ce5c7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:24.747327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:24.764847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:24.784097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 904/1798] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:24 2022] PUT /identity/v3/projects/27c179a7c3374b32a9ddebadaf825a0a/users/b6aa1482fbbf4d24b01d7d792f2ce5c7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:24.786225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:24.789039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:24.824787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e8c69-f8a3-497c-8673-accf317b891b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.041492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b01fea-4e83-4689-8a90-392c0f53bcfd admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.061407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.062186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.062470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.062742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.063400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.070993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.082081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.082800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.083079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.083348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] PATH_INFO: `/v3/users/f225ee1a9e9f49eeba14e162eea7230d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.084738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f225ee1a9e9f49eeba14e162eea7230d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.086811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.125722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 905/1799] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:25.126687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:25.132524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.176663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686cbb3e-da45-4624-ae88-59679aac4dd0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.205535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.206188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.206468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.206744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] PATH_INFO: `/v3/projects/497c5fb9a1e147a182b792ae87374e08` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.215965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=497c5fb9a1e147a182b792ae87374e08)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.215965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.218078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f225ee1a9e9f49eeba14e162eea7230d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.219084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f225ee1a9e9f49eeba14e162eea7230d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.236660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f225ee1a9e9f49eeba14e162eea7230d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.237632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f225ee1a9e9f49eeba14e162eea7230d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.259434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f225ee1a9e9f49eeba14e162eea7230d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.313024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 895/1800] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:24 2022] DELETE /identity/v3/users/f225ee1a9e9f49eeba14e162eea7230d => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:25.313024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:25.313024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.319685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:25.356559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '497c5fb9a1e147a182b792ae87374e08', 'request_id': 'req-bc818845-9b54-4b6b-94d5-150d4c3a6730'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.370963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '497c5fb9a1e147a182b792ae87374e08', 'request_id': 'req-bc818845-9b54-4b6b-94d5-150d4c3a6730'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.398033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '497c5fb9a1e147a182b792ae87374e08', 'request_id': 'req-bc818845-9b54-4b6b-94d5-150d4c3a6730'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.435668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] The token cache is being invalidate because project 497c5fb9a1e147a182b792ae87374e08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:25.435923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.442809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.447538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 906/1801] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:25 2022] DELETE /identity/v3/projects/497c5fb9a1e147a182b792ae87374e08 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:25.451831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:25.459224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.527938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327e7cd2-2e37-4f0b-b19c-38865a380173 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.549201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:25.575102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc818845-9b54-4b6b-94d5-150d4c3a6730 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.585371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.585371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.586624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.586624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] PATH_INFO: `/v3/users/46d68e2e3a5b41fb9b3355315feec299` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.589099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46d68e2e3a5b41fb9b3355315feec299)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.594149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.682113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46d68e2e3a5b41fb9b3355315feec299'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.683347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46d68e2e3a5b41fb9b3355315feec299'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.687422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46d68e2e3a5b41fb9b3355315feec299'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.711838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46d68e2e3a5b41fb9b3355315feec299'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.712029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.713514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.714204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.714204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] PATH_INFO: `/v3/projects/27c179a7c3374b32a9ddebadaf825a0a/users/b6aa1482fbbf4d24b01d7d792f2ce5c7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.718199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27c179a7c3374b32a9ddebadaf825a0a, user_id=b6aa1482fbbf4d24b01d7d792f2ce5c7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:25.722290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:25.728008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9656c79e-57a7-4cd8-83e8-9aa4c4cb0cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46d68e2e3a5b41fb9b3355315feec299'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:25.738635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 896/1802] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:25 2022] PUT /identity/v3/projects/27c179a7c3374b32a9ddebadaf825a0a/users/b6aa1482fbbf4d24b01d7d792f2ce5c7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:25.739753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:25.741519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.777834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 907/1803] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:25 2022] DELETE /identity/v3/users/46d68e2e3a5b41fb9b3355315feec299 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:25.777834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.777834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.778183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.829876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] MFA Rules not processed for user `b6aa1482fbbf4d24b01d7d792f2ce5c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:25.831125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.844578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa88c1d7-b168-46eb-8131-cd977eb91fb3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:25.856695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:25.988289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 908/1804] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:25.988480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:25.988480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:25.988480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:25.988480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:25.991427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:25.999433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.001813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.014130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.016912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.041767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 897/1805] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:26.101770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e4273-358f-4392-a26d-551f2a350b4f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.105856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.106802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.107934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.108413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.110539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.218019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.218939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.220368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.220833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.237128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 909/1806] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:26.289376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.291124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.339755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:26.387637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c62ff-8459-47f3-a83d-b35053c84b06 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.395099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.396353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.396636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.396915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] PATH_INFO: `/v3/projects/e195787110a64e63bf841822f7607bd6` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.398093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e195787110a64e63bf841822f7607bd6)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.400865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.406421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ba401-8fc2-4fca-900e-017e191ac0ac service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.422929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.423678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.424010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.424241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] PATH_INFO: `/v3/projects/546737f8eb824779a96c599eb387ef48` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.424343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:26.425701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546737f8eb824779a96c599eb387ef48)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.427655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.491930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e195787110a64e63bf841822f7607bd6', 'request_id': 'req-7568c65b-3a80-448e-96df-7f65fd34fe27'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.505284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e195787110a64e63bf841822f7607bd6', 'request_id': 'req-7568c65b-3a80-448e-96df-7f65fd34fe27'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.519367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546737f8eb824779a96c599eb387ef48', 'request_id': 'req-f8abb944-bf50-400c-bb67-18625c6f7ac0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.525679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e195787110a64e63bf841822f7607bd6', 'request_id': 'req-7568c65b-3a80-448e-96df-7f65fd34fe27'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.533094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546737f8eb824779a96c599eb387ef48', 'request_id': 'req-f8abb944-bf50-400c-bb67-18625c6f7ac0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.542972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546737f8eb824779a96c599eb387ef48', 'request_id': 'req-f8abb944-bf50-400c-bb67-18625c6f7ac0'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.550815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] The token cache is being invalidate because project e195787110a64e63bf841822f7607bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:26.551166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.553490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7568c65b-3a80-448e-96df-7f65fd34fe27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.556377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 910/1807] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:26 2022] DELETE /identity/v3/projects/e195787110a64e63bf841822f7607bd6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:26.561797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd33d4-d039-45c5-b905-9a27a6420455 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.562445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd33d4-d039-45c5-b905-9a27a6420455 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.562927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd33d4-d039-45c5-b905-9a27a6420455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.573589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] The token cache is being invalidate because project 546737f8eb824779a96c599eb387ef48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:26.573887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.576990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8abb944-bf50-400c-bb67-18625c6f7ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:26.581659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 898/1808] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:26 2022] DELETE /identity/v3/projects/546737f8eb824779a96c599eb387ef48 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:26.586305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b960d8-3369-4782-82f3-b666f06606e8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.586563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b960d8-3369-4782-82f3-b666f06606e8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.586846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b960d8-3369-4782-82f3-b666f06606e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.597494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-aecd33d4-d039-45c5-b905-9a27a6420455 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:26.599318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-aecd33d4-d039-45c5-b905-9a27a6420455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.614563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-19b960d8-3369-4782-82f3-b666f06606e8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:26.616905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-19b960d8-3369-4782-82f3-b666f06606e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.713808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 899/1809] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:26.715289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.715661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.715936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.746753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:26.755659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 911/1810] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:26.757494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.775152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.775372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.778419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.790736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 900/1811] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:26.796258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.799841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:26.801075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:26.809929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99acc75e-70ab-4c9e-9894-26069d45b71f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.810645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 912/1812] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:26.816475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.828932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.829708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.830641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.831020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.831478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758bd7d-cf57-4c4e-9533-acdce2771b9e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.831935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:26.832472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.834956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.841603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.842327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.842610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.842885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.844081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:26.844401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.851736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 901/1813] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:26.852153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.857835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.877161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 913/1814] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:26.877642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4b01c-72c6-4036-83d4-8844476c9aef admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.886113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.890587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.891341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.891743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.892171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.896005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.899184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.903003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966769a-71a0-41c6-bb6b-6b2e7d51631e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:26.908252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:26.908869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:26.909716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:26.909716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:26.910045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:26.911983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:26.932964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 902/1815] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:26.938838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.950139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 914/1816] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:26.951957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:26.970110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:27.024126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d49edc-7687-43c3-99f3-dbce1ab62d14 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.030271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb65186-59f2-4372-990f-a0a743070708 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.031737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.032503 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.032819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.033265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.033899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.035153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.036324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.036450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.036526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.043707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.044937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.047452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.057328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:27.067357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 903/1817] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/users => generated 292 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:27.070788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.080176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 915/1818] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:26 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:27.081001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.085571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6d2f-41a7-4b15-bac2-5efafec2f2bc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.090310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.090894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.091174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.091332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aef677-6004-4f01-b03f-9f5372d2ce05 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.091609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.092645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.094324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.096197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.096797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.097071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.097461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.097992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.099675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.110146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 904/1819] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:27.113941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.117602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 916/1820] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:27.119378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.128409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a62fd6-b66e-4022-af98-774ac5acf73c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.133099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.133908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.134196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.136703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.136703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.137026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.149427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5c414-2433-4e94-8a8d-dca3c74e310e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.153394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 905/1821] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:27.154517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.156814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.165080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.165724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.166004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.166279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.166926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.168619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.176792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f78647-9f36-486b-8366-2b4bd39eef0e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.182336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.183047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.183276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.183719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] PATH_INFO: `/v3/users/0958d0bfe35c4f4aac3e00f0528b6674` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.184882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958d0bfe35c4f4aac3e00f0528b6674)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.187695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.194531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 917/1822] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:27.195627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.221248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e09e5-74db-4ce3-bfeb-f5c0e6a60c60 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.233192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.233893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.234169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.234525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] PATH_INFO: `/v3/projects/be1fda16bc7f462281c0984c9f61f178/users/751bb6c7559940778e4bbb173308cb67/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.268916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1fda16bc7f462281c0984c9f61f178, user_id=751bb6c7559940778e4bbb173308cb67, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.271672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.310770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 918/1823] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:27 2022] PUT /identity/v3/projects/be1fda16bc7f462281c0984c9f61f178/users/751bb6c7559940778e4bbb173308cb67/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:27.310770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.328739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958d0bfe35c4f4aac3e00f0528b6674'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:27.329929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958d0bfe35c4f4aac3e00f0528b6674'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:27.343681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958d0bfe35c4f4aac3e00f0528b6674'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:27.344996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958d0bfe35c4f4aac3e00f0528b6674'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:27.356127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f61f7b5d-2114-4b99-81a1-445ce7661e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958d0bfe35c4f4aac3e00f0528b6674'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:27.380602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 906/1824] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:27 2022] DELETE /identity/v3/users/0958d0bfe35c4f4aac3e00f0528b6674 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:27.382451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56810a-3646-4b34-8f3b-f460ed67e6f5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.383645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56810a-3646-4b34-8f3b-f460ed67e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.384180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56810a-3646-4b34-8f3b-f460ed67e6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.418195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7c56810a-3646-4b34-8f3b-f460ed67e6f5 None None] MFA Rules not processed for user `751bb6c7559940778e4bbb173308cb67`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:27.420764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7c56810a-3646-4b34-8f3b-f460ed67e6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.456885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea91fc-ecac-4043-8a4f-d7cbe96db070 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.518020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:27.553485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 907/1825] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:27.555028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.555375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.555769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.578947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:27.581463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.586722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.587806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.588104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.588607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] PATH_INFO: `/v3/projects/66266f1b5e004a99bb051762025fcba5/users/84dbd0f3d1404d5ba14a08ff7cdceef7/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.598059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 908/1826] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:27.599257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.601313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.613408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66266f1b5e004a99bb051762025fcba5, user_id=84dbd0f3d1404d5ba14a08ff7cdceef7, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.616631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b1428-c878-476a-a39f-0a11c06db4e2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.617576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ffb3c-5d35-466f-8f3f-e2f39f84a4ab None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.624646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.625412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.625761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.626108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.626819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.629344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.641943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 919/1827] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:27 2022] PUT /identity/v3/projects/66266f1b5e004a99bb051762025fcba5/users/84dbd0f3d1404d5ba14a08ff7cdceef7/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:27.652429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.652711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.653005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.684139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 909/1828] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/projects => generated 383 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:27.688193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.706810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] MFA Rules not processed for user `84dbd0f3d1404d5ba14a08ff7cdceef7`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:27.708168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.763860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:27.798776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909edf9-e3d7-4445-b1f5-c4faf81abf77 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.805355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.805983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.806252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.806530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.807171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.812482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.819935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 920/1829] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:27.824252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.826504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.851359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 910/1830] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/users => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:27.852818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.856420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:27.870406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac1bd4-6338-4efe-a955-cc50add891c0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.875944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.876561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.876839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.877110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.878120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.880028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.902705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e0a0a-cace-4883-871a-300ab441d39f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:27.908443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:27.909230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:27.909602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:27.909863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:27.922034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:27.923187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 911/1831] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:27.924408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.926586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:27.943659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 921/1832] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:27.944500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:27.960353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d7a00-dd5e-41c1-b510-342569496a1a service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.062124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.062377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d4e50-1fa3-49b6-a3fb-0ae363005412 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.062757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.063039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.063314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.063991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.065941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.076495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.077187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.077505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.078118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.078419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.082375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.098628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 922/1833] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:27 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:28.104171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 912/1834] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:27 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:28.108883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.110043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.132329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0f020-9295-49ca-bff2-d29c4973b9f0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.137563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318eab29-7c68-4e7f-b6a2-4c7a33acad6a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.139965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.141276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.141276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.141761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] PATH_INFO: `/v3/projects/3eee331c1bd746178c51985200703c62/users/67b5e0eea82641858eddc71015dc9f58/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.151812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.153410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.154455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.154913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.156164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.159215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.174950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee331c1bd746178c51985200703c62, user_id=67b5e0eea82641858eddc71015dc9f58, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.177867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 923/1835] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:28.182526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.182630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.201798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d7571-309c-4d59-a5b5-f1a24f53fc07 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.209074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:28.218102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 913/1836] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:28 2022] PUT /identity/v3/projects/3eee331c1bd746178c51985200703c62/users/67b5e0eea82641858eddc71015dc9f58/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:28.219395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.269188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:28.287890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.288565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.288846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.289119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] PATH_INFO: `/v3/projects/e1310a6268f7417c800e1bbcd43727a8/users/8b02888cb04840b9b8e0c50339da07d1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.298501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677543b-af80-46b9-86f1-96c363890e3d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.303819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.304500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.304904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.305265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.305980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.306974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1310a6268f7417c800e1bbcd43727a8, user_id=8b02888cb04840b9b8e0c50339da07d1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.307718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.309657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.319327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 914/1837] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:28.323043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.329045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 924/1838] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:28 2022] PUT /identity/v3/projects/e1310a6268f7417c800e1bbcd43727a8/users/8b02888cb04840b9b8e0c50339da07d1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:28.333201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.334363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa238ff-ba6d-4cf1-be8d-cb70109c791b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.408539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.409200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.409478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.409750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] PATH_INFO: `/v3/projects/3eee331c1bd746178c51985200703c62/users/67b5e0eea82641858eddc71015dc9f58/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.411093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f07d35-6bc9-43cb-86ec-29a41be1d71b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.411719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eee331c1bd746178c51985200703c62, user_id=67b5e0eea82641858eddc71015dc9f58, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.414415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.416545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.417431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.418031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.418321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.418968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.421002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58205e4c-636e-4802-8fc0-2ea12c078c0b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.426221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 915/1839] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:28 2022] PUT /identity/v3/projects/3eee331c1bd746178c51985200703c62/users/67b5e0eea82641858eddc71015dc9f58/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:28.427049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.428661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.438853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 925/1840] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:28.440284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.440655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.440838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.469290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] MFA Rules not processed for user `67b5e0eea82641858eddc71015dc9f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:28.470415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.511808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b69da5-c9ed-44c3-a13d-d234119d5a35 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.518623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.519463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.519936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.520225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] PATH_INFO: `/v3/projects/774adc483327412781f28e0c9b7cae91` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.521443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=774adc483327412781f28e0c9b7cae91)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.523336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.546077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 926/1841] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:28.547044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.558340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97822747-0418-4231-b48c-35d4b9c2ec4b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.564715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.565521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.565925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.566209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] PATH_INFO: `/v3/projects/e1310a6268f7417c800e1bbcd43727a8/users/8b02888cb04840b9b8e0c50339da07d1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.566409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:28.568315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1310a6268f7417c800e1bbcd43727a8, user_id=8b02888cb04840b9b8e0c50339da07d1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.571136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.580802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '774adc483327412781f28e0c9b7cae91', 'request_id': 'req-5aefd407-ca9a-40eb-a166-b49bed4d86d3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.582609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 927/1842] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:28 2022] PUT /identity/v3/projects/e1310a6268f7417c800e1bbcd43727a8/users/8b02888cb04840b9b8e0c50339da07d1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:28.583430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.587805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '774adc483327412781f28e0c9b7cae91', 'request_id': 'req-5aefd407-ca9a-40eb-a166-b49bed4d86d3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.593438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.593735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '774adc483327412781f28e0c9b7cae91', 'request_id': 'req-5aefd407-ca9a-40eb-a166-b49bed4d86d3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.606254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] The token cache is being invalidate because project 774adc483327412781f28e0c9b7cae91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:28.606540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.607774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5aefd407-ca9a-40eb-a166-b49bed4d86d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.609410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 916/1843] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:28 2022] DELETE /identity/v3/projects/774adc483327412781f28e0c9b7cae91 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:28.610692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.610976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.611246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.639198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] MFA Rules not processed for user `8b02888cb04840b9b8e0c50339da07d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:28.640431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.642052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:28.658822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f2b8c-f814-44a0-b49b-eebfa8af98c1 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.662723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.663335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.663655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.663933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.665703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.712429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 917/1844] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:28.713277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.719025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.732861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.734288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.746707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 928/1845] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:28.748830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.756100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.775445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12026fad-04e6-422a-999f-5b8a60d7e4ae service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.784742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.793431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.793725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.794156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.820142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cca389-4075-44bf-967e-d47865a8c0f8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.826355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.829136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.830343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.831326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.832141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.832141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] PATH_INFO: `/v3/users/0baa36614896471185973630eb71e8fb` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.833255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0baa36614896471185973630eb71e8fb)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:28.835446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:28.852714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 929/1846] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:28.926477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:28.928023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.934308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0baa36614896471185973630eb71e8fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.936321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0baa36614896471185973630eb71e8fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.939145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:28.941833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbd7c39-bbc7-4f45-8298-7c2bc7186d06 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:28.947253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:28.947986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:28.948590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:28.948715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:28.952578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:28.956899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0baa36614896471185973630eb71e8fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.958548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0baa36614896471185973630eb71e8fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.970349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0baa36614896471185973630eb71e8fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:28.993266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 918/1847] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:28 2022] DELETE /identity/v3/users/0baa36614896471185973630eb71e8fb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:29.049378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.050861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.072520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 930/1848] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:29.347756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.349212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.352187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.361746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cfc5cb-eaca-4d1d-95f5-2939a93f6909 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.459421 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.460084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.460362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.460631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.464172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.515513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cd414-592d-466e-8038-e9e28221429c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.524122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b02888cb04840b9b8e0c50339da07d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1310a6268f7417c800e1bbcd43727a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.524853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.525327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.525835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.527880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:29.528323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.529760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:29.531876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.555314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 919/1849] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:29.556220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.557955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.584443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.585857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.596665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 931/1850] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:29.597510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.607959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470ce90-5d82-46a3-953a-f2bc41c8bab4 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.612757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b02888cb04840b9b8e0c50339da07d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1310a6268f7417c800e1bbcd43727a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.613365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.613641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.613911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.614531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.616529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.634347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531e947-6f1b-43ff-bfea-8fce30cc8688 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.641052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.641880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.642204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.642514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] PATH_INFO: `/v3/projects/671a0a312b9c4f6596614fc534657941` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.643777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671a0a312b9c4f6596614fc534657941)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.646479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.649545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 932/1851] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:29 2022] POST /identity/v3/projects => generated 354 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:29.653810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.707191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671a0a312b9c4f6596614fc534657941', 'request_id': 'req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:29.713564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671a0a312b9c4f6596614fc534657941', 'request_id': 'req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:29.722770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=1,keystone:DELETE=9,keystone:SELECT=90 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:29.724560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671a0a312b9c4f6596614fc534657941', 'request_id': 'req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:29.738798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ddf5f-3a3e-4463-9d08-ad4dd0456fa6 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.741394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] The token cache is being invalidate because project 671a0a312b9c4f6596614fc534657941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:29.741650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:29.742542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9a8bed55-6833-4f70-a9ed-e55b3ee46a96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:29.744429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 920/1852] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:29 2022] DELETE /identity/v3/projects/671a0a312b9c4f6596614fc534657941 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:29.750661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.750950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.751233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.780992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:29.782215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.811050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b02888cb04840b9b8e0c50339da07d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1310a6268f7417c800e1bbcd43727a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.811713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.812004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.812678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.813343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:29.813662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.815432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d0a1b8-b9d5-4c2c-bed3-de902e31e5a5 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.828097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 933/1853] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:29.852818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 921/1854] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:29.861214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.861506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.861803 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.872517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.874377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.885350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:29.886587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:29.891370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba18fe5-d76a-4363-a3d3-4a56941e04b0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.897783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b02888cb04840b9b8e0c50339da07d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1310a6268f7417c800e1bbcd43727a8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.898427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.898711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.898985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] PATH_INFO: `/v3/projects/947bc4c1b9ae442e9c48f366416a5494` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.900094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 934/1855] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:29.900224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorizing `identity:delete_project(project_id=947bc4c1b9ae442e9c48f366416a5494)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.902141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.903371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.915261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fca2c2-f57f-486f-b42b-13239119fd68 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:29.926025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:29.926701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:29.927055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:29.929334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:29.930028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:29.932066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:29.934333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:29.968584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 935/1856] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:29.976826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:29.992595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947bc4c1b9ae442e9c48f366416a5494', 'request_id': 'req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.002484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947bc4c1b9ae442e9c48f366416a5494', 'request_id': 'req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.007918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706a923-8b7b-4f02-9de9-1a22682b01f3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.012500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947bc4c1b9ae442e9c48f366416a5494', 'request_id': 'req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.031586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:30.031723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] The token cache is being invalidate because project 947bc4c1b9ae442e9c48f366416a5494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:30.032000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.032785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.035143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 922/1857] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:29 2022] DELETE /identity/v3/projects/947bc4c1b9ae442e9c48f366416a5494 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:30.087748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.088608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.089067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.089345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.089979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.092605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.123340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 936/1858] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:29 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:30.128131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.129700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.145982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa8baf-c4de-4c7f-9fcf-03d745dd6687 tempest-VolumeQuotaClassesTest-25844015 tempest-VolumeQuotaClassesTest-25844015-project-admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.237968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.238584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.238853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.239128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.240458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.246166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.281495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.283681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.285018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 923/1859] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:30.288964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.293918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:30.298169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef69abe-dec5-49f7-8a28-c12352c34448 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.300240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265a2367-7e53-442c-8bf5-a773a4493ac0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.303687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.304646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.305079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.305364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] PATH_INFO: `/v3/users/84dbd0f3d1404d5ba14a08ff7cdceef7` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.306444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.306730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dbd0f3d1404d5ba14a08ff7cdceef7)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.307082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.307581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.308265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.308802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.309036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.312041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.323086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 924/1860] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:30.327235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.337740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c669-b69b-4627-80ed-76dea406c848 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.347657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.348268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.348550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.348826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.351510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.353121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.367274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 925/1861] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:30.370354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dbd0f3d1404d5ba14a08ff7cdceef7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.370898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.371062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dbd0f3d1404d5ba14a08ff7cdceef7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.371718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dbd0f3d1404d5ba14a08ff7cdceef7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.373785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.384588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dbd0f3d1404d5ba14a08ff7cdceef7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.404866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3313a16-190b-45b7-a749-1f3e54dbc979 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.423076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.423076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.423076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.423076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] PATH_INFO: `/v3/projects/f6dc6f31816145b3866b77f46477c088/users/c49abf539beb465aa392110f7701b809/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.464780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6dc6f31816145b3866b77f46477c088, user_id=c49abf539beb465aa392110f7701b809, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.468527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc333429-b24f-45d5-9638-2b7caadf03f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.490345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-adfb85d3-f085-4f7b-adff-ba244d4f089f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dbd0f3d1404d5ba14a08ff7cdceef7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:30.513952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 937/1862] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:30 2022] DELETE /identity/v3/users/84dbd0f3d1404d5ba14a08ff7cdceef7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:30.518719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.519025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.519352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.539230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:30.541334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.549892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 926/1863] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:30 2022] PUT /identity/v3/projects/f6dc6f31816145b3866b77f46477c088/users/c49abf539beb465aa392110f7701b809/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:30.561001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.561287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.561566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.593872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] MFA Rules not processed for user `c49abf539beb465aa392110f7701b809`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:30.595401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.644451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 938/1864] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:30.651264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.653335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:30.691348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:30.705636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 927/1865] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:30.712152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.729405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520610-db70-4637-80fd-1b4b152e3ff2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.734036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620282f2-cf31-418f-9d49-54d83ed5e678 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.735997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.736411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.736693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.737089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.738353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.738462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.738550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.738951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.739266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.740117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.750395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.752439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.765338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 939/1866] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:30.779524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 928/1867] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/projects => generated 397 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:30.787188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.802982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600b7ff-66cb-4cfd-96c4-ba8d317eb136 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.874574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.875187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.875462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.875759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.876426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.878367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.900381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 940/1868] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:30 2022] POST /identity/v3/users => generated 305 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:30.905645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.917140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f40ca-368d-4c64-9130-9e0b9ead1daf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.922435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.923207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.923512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.923790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.924427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.926013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:30.941560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 929/1869] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:30.945629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:30.958328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8b8f5-fa11-431a-bf16-921501924ff1 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:30.965537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:30.966196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:30.967032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:30.967801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] PATH_INFO: `/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22/users/6585aacc20b540f6a24468092e9080f0/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:30.986072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78512c7929f34c1bbb2bb6201ff1ea22, user_id=6585aacc20b540f6a24468092e9080f0, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:30.988882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.003947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 941/1870] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:30 2022] PUT /identity/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22/users/6585aacc20b540f6a24468092e9080f0/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:31.008643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.022124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73a5d53-3596-4afe-bc32-ef3e66662e3b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.105647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.108347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.114678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.115520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.116025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.116351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.117133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.127511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.130629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37a2d1-e74b-4a42-a87f-308dd684d462 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.131891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 930/1871] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:31.136329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.140976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.141631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.141915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.142249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] PATH_INFO: `/v3/projects/66266f1b5e004a99bb051762025fcba5` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.143412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66266f1b5e004a99bb051762025fcba5)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.145423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.159118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0c3e9-26af-41ce-bff1-ee710ebbac7b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.164829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.165709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.165943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.166219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] PATH_INFO: `/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22/users/6585aacc20b540f6a24468092e9080f0/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.168135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78512c7929f34c1bbb2bb6201ff1ea22, user_id=6585aacc20b540f6a24468092e9080f0, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.171741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152d8e7-5f11-4f00-9ba3-dc9d7081eef1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.175592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:31.186712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 931/1872] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:31 2022] PUT /identity/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22/users/6585aacc20b540f6a24468092e9080f0/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:31.197596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.197884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.198164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.209090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66266f1b5e004a99bb051762025fcba5', 'request_id': 'req-da8693e4-aaed-484c-ab34-18e9ddb549c9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.215323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66266f1b5e004a99bb051762025fcba5', 'request_id': 'req-da8693e4-aaed-484c-ab34-18e9ddb549c9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.224389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66266f1b5e004a99bb051762025fcba5', 'request_id': 'req-da8693e4-aaed-484c-ab34-18e9ddb549c9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.229458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] MFA Rules not processed for user `6585aacc20b540f6a24468092e9080f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:31.230670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.240196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] The token cache is being invalidate because project 66266f1b5e004a99bb051762025fcba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:31.241941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.242698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.244569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 942/1873] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:31 2022] DELETE /identity/v3/projects/66266f1b5e004a99bb051762025fcba5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:31.249411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.250813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.269203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:31.322153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 932/1874] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:31 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:31.336226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.338100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.344292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8693e4-aaed-484c-ab34-18e9ddb549c9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.352155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.352834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.353111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.353383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] PATH_INFO: `/v3/users/8b02888cb04840b9b8e0c50339da07d1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.354529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b02888cb04840b9b8e0c50339da07d1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.356500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.404933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ba56d-c84f-46d0-a66b-926d1181a59a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.408596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.409342 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.409626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.409896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.417232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b02888cb04840b9b8e0c50339da07d1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.418618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b02888cb04840b9b8e0c50339da07d1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.420241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b02888cb04840b9b8e0c50339da07d1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.421705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.423244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.430257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b02888cb04840b9b8e0c50339da07d1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.435142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 933/1875] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:31.439073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b02888cb04840b9b8e0c50339da07d1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:31.472516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 943/1876] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:31 2022] DELETE /identity/v3/users/8b02888cb04840b9b8e0c50339da07d1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:31.536966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.546818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425d63c-b444-4a39-8d36-fecf15702c73 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.603726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.604452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.604825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.605083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.607782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.651663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:31.685781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.687455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:31.697549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 934/1877] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:31.887223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.888765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.895137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:31.896695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:31.985833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e7d5-f8f1-4446-b442-c75596300eb4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:31.991406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:31.992387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:31.992853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:31.993211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] PATH_INFO: `/v3/projects/e1310a6268f7417c800e1bbcd43727a8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:31.994414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1310a6268f7417c800e1bbcd43727a8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:31.996414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.012606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442116b-fc3f-464c-aa29-d025fc1d45c5 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.019911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.020724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.021016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.021291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] PATH_INFO: `/v3/users/751bb6c7559940778e4bbb173308cb67` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.022466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] RBAC: Authorizing `identity:delete_user(user_id=751bb6c7559940778e4bbb173308cb67)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.024454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.053445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:32.080309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1310a6268f7417c800e1bbcd43727a8', 'request_id': 'req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.083223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1310a6268f7417c800e1bbcd43727a8', 'request_id': 'req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.096944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1310a6268f7417c800e1bbcd43727a8', 'request_id': 'req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.097438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751bb6c7559940778e4bbb173308cb67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.098971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751bb6c7559940778e4bbb173308cb67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.111788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751bb6c7559940778e4bbb173308cb67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.112646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751bb6c7559940778e4bbb173308cb67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.115679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] The token cache is being invalidate because project e1310a6268f7417c800e1bbcd43727a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:32.115984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.116893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c1f2857f-305a-4091-bdfd-e05ef3e72ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.119561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 944/1878] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:31 2022] DELETE /identity/v3/projects/e1310a6268f7417c800e1bbcd43727a8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:32.124651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2cc-4f7c-4353-8a1b-b787c12d9472 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.125021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2cc-4f7c-4353-8a1b-b787c12d9472 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.125365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b2cc-4f7c-4353-8a1b-b787c12d9472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.131745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-77b5c9f9-1cd1-49c7-9c85-74fefd25227b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751bb6c7559940778e4bbb173308cb67'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:32.163885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 935/1879] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:31 2022] DELETE /identity/v3/users/751bb6c7559940778e4bbb173308cb67 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:32.166574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.166574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.166574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.187822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:32.189346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cbf7b2cc-4f7c-4353-8a1b-b787c12d9472 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:32.189509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:32.190644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cbf7b2cc-4f7c-4353-8a1b-b787c12d9472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:32.257549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:32.275610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 936/1880] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:32.284191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.285759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:32.307792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 945/1881] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:32.317860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.318148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.318423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.342852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:32.345035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:32.354186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 946/1882] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:32.358428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.366868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5435d01-06d4-412e-8fac-56191b38f858 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.373936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344584ae-f231-4553-8cd4-5457450b32c6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.376176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.379672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.379910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.380192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.380296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.380469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.380559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.380802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.381462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:32.381759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.384030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.392064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.393384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.401748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 947/1883] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:54:32.406909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.407922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 937/1884] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:32.417529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d079315-97fe-465d-8545-9ee33af18d1b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.422539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.423180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.423625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.423893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.424616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.426633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.477824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 948/1885] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/projects => generated 385 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:32.482835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.500972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d267efc3-acee-4faa-a9b0-65f489b01514 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.598687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.599766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.600184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.600731 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.601989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.606352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.655571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 938/1886] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:32.657906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.679460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3eac9-1168-432c-ae99-b6f8c1a9d3ed admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.687058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.688066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.688673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.688673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.689385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.692733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.707953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 949/1887] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:32.709649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.721713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff3f2a-be48-487c-b7a9-32b57f1400d4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.729487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.730949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.731375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.732745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.733668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.735691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a923bd2-1e15-42da-879f-b9c247ba9662 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.751085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 939/1888] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:32.755569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:32.769609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ba664-d418-4bee-bb1b-d1d573a2369c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:32.775991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:32.776806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.777003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.777445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] PATH_INFO: `/v3/projects/932e162ee57b4127ad46904509d82642/users/1eaab405c8f64891ba51a9f330d5ace9/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.799670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=932e162ee57b4127ad46904509d82642, user_id=1eaab405c8f64891ba51a9f330d5ace9, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:32.803815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:32.837045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 950/1889] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:32 2022] PUT /identity/v3/projects/932e162ee57b4127ad46904509d82642/users/1eaab405c8f64891ba51a9f330d5ace9/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:32.849641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:32.850006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:32.850300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:32.889518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] MFA Rules not processed for user `1eaab405c8f64891ba51a9f330d5ace9`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:32.890567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.006606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 940/1890] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:33.011904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.055458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.057247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.074638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.111204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.143455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c62996-7316-41f9-910a-0262df26be10 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.151082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.151951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.152170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedcd9b0-e435-4bef-833f-c8c1c7b21f6f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.152533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.152950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.154765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.156705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.158975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.159660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.160012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.160224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] PATH_INFO: `/v3/projects/be1fda16bc7f462281c0984c9f61f178` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.161662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1fda16bc7f462281c0984c9f61f178)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.164114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.191409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 951/1891] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:33 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:33.195419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.231542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1fda16bc7f462281c0984c9f61f178', 'request_id': 'req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.240655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1fda16bc7f462281c0984c9f61f178', 'request_id': 'req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.249838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1fda16bc7f462281c0984c9f61f178', 'request_id': 'req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.266709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] The token cache is being invalidate because project be1fda16bc7f462281c0984c9f61f178 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:33.267277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.268060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.270276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 941/1892] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:33 2022] DELETE /identity/v3/projects/be1fda16bc7f462281c0984c9f61f178 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:33.276741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.279272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.296687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96104f42-d3a9-4d45-b316-c2e7cfe7abb8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.368292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66dad0-36c7-40bd-bac7-84d8bb9c2fae admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.373690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.374336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.374611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.374889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] PATH_INFO: `/v3/users/67b5e0eea82641858eddc71015dc9f58` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.376142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67b5e0eea82641858eddc71015dc9f58)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.379208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.384863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.385630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.385919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.386876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.386986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.389953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.421419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 952/1893] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:33 2022] POST /identity/v3/users => generated 293 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:33.425678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.427878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.444629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.452739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67b5e0eea82641858eddc71015dc9f58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.453471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67b5e0eea82641858eddc71015dc9f58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.463172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67b5e0eea82641858eddc71015dc9f58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.463621 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d72264-d006-4445-9b16-fea4c59d079d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.464164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67b5e0eea82641858eddc71015dc9f58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.469515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.470315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.470509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.471026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.471643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.472618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67b5e0eea82641858eddc71015dc9f58'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:33.473283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.485181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 953/1894] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:33.489564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.491346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.502502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 942/1895] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:33 2022] DELETE /identity/v3/users/67b5e0eea82641858eddc71015dc9f58 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:33.505338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5248af-126f-4702-b88f-31a6cd15ea84 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.572895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:33.584376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.585520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.585920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.586257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.587502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.589912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473a1a9-7a55-4d46-9b11-9d3398595172 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.607847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 954/1896] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:33.615862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.630994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d1e519-aa7b-44c5-b7d7-f047d1510d61 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.636325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.637186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.637473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.637753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] PATH_INFO: `/v3/projects/4ad1f8c344644575924943c8619b55bd/users/5a47f816ba4441388a0ef25ba25ad6a3/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.654593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ad1f8c344644575924943c8619b55bd, user_id=5a47f816ba4441388a0ef25ba25ad6a3, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.657340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.674012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 943/1897] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:33 2022] PUT /identity/v3/projects/4ad1f8c344644575924943c8619b55bd/users/5a47f816ba4441388a0ef25ba25ad6a3/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:33.687406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.688052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.688315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.721440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] MFA Rules not processed for user `5a47f816ba4441388a0ef25ba25ad6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:33.722781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.805575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 955/1898] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:33.811659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.836268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:33.837910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:33.894975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0668af-89b1-4def-bf6e-33ad8cd0dfa9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.900024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.900651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.900923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.901193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.901816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.903772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.924352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adba20-e6a3-4b5e-bf0c-4c13606c8be5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:33.930534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:33.931655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:33.931655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:33.932046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] PATH_INFO: `/v3/projects/3eee331c1bd746178c51985200703c62` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:33.933328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eee331c1bd746178c51985200703c62)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:33.936007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 944/1899] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:33 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:33.936170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:33.939926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.021371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eee331c1bd746178c51985200703c62', 'request_id': 'req-d5a2b846-fe08-432a-b9f2-7e31901a9e79'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:34.030683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eee331c1bd746178c51985200703c62', 'request_id': 'req-d5a2b846-fe08-432a-b9f2-7e31901a9e79'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:34.041518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eee331c1bd746178c51985200703c62', 'request_id': 'req-d5a2b846-fe08-432a-b9f2-7e31901a9e79'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:34.046417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03614f7b-a640-487d-b407-8b51872d33ed admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.058341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] The token cache is being invalidate because project 3eee331c1bd746178c51985200703c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:34.058650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:34.059796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d5a2b846-fe08-432a-b9f2-7e31901a9e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:34.063623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 956/1900] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:33 2022] DELETE /identity/v3/projects/3eee331c1bd746178c51985200703c62 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:34.069903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb4ec6-c70e-486a-8f76-d2b8e24a2ab6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.070441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb4ec6-c70e-486a-8f76-d2b8e24a2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.070828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb4ec6-c70e-486a-8f76-d2b8e24a2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.109484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e6bb4ec6-c70e-486a-8f76-d2b8e24a2ab6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:34.110947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e6bb4ec6-c70e-486a-8f76-d2b8e24a2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.111648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:34.120336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:34.177257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.177998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.178357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.178693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.179413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.181436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.215231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 945/1901] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:33 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:34.219982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.221934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.241127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f8d06-db54-40b7-874a-cc8ed90bd5a8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.241317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 957/1902] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:34.242618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.242907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.243181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.247907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.248837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.249295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.250018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.250863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.252773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.263613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 946/1903] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:34.264082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:34.265521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.267798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.276165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 958/1904] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:34.280743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.283202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254a8bc-8c95-477e-a80e-56851f8ba9ec admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.290004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef642ed-872c-4e60-af34-b2e605c54f77 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.294795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.295769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.296143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.296452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] PATH_INFO: `/v3/projects/a4d119bc2d86443a848f416d557a05aa/users/43b9c63c1d54409e9f21334999feed1d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.299391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.300205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.300490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.300766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.301431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:34.301825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.303436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.312819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d119bc2d86443a848f416d557a05aa, user_id=43b9c63c1d54409e9f21334999feed1d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.315487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.316741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 959/1905] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:54:34.321293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.335030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 947/1906] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:34 2022] PUT /identity/v3/projects/a4d119bc2d86443a848f416d557a05aa/users/43b9c63c1d54409e9f21334999feed1d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:34.335757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a6b52-f404-4053-9deb-2bdabbe99a9b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.338826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.409755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.410500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.410848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.411230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.411965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.414735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.425542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647789ca-0ef7-48fa-ab27-4c3ff489bf47 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.433091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.433938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.434230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.434506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.435656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.437263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.451547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 948/1907] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:34.455024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.469231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 960/1908] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:34.472020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.479492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4a60-1f23-4937-bdfb-067c78b6f338 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.567279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b1c7-d4ee-414c-91da-664f80b4e169 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.573451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.574179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.574556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.574909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.576370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.578731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.606904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.607781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.608064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.608340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] PATH_INFO: `/v3/projects/a4d119bc2d86443a848f416d557a05aa/users/43b9c63c1d54409e9f21334999feed1d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.610422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4d119bc2d86443a848f416d557a05aa, user_id=43b9c63c1d54409e9f21334999feed1d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.613241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a65c0-9299-4d50-808d-e088df5d2b01 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.617192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 961/1909] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:34.618660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.624385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 949/1910] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:34 2022] PUT /identity/v3/projects/a4d119bc2d86443a848f416d557a05aa/users/43b9c63c1d54409e9f21334999feed1d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:34.630073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35a438-6b1b-4ac0-bcc6-e9fc04ab135e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.633903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:34.634781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.635638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.635933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.660500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:34.670356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] MFA Rules not processed for user `43b9c63c1d54409e9f21334999feed1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:34.672070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.713683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.714295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.714619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.714896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.715562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.717922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.735276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 962/1911] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:34.746826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.752322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 950/1912] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:34.758728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa245d40-a4fe-4046-a121-b6fbe0d7bae3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.764388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.764531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.765002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.765283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.765557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.766006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.766202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.767919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.779322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 963/1913] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:34.783556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:34.793633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f522c-54e8-4e42-ba80-b873720d78d4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.801131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.801655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.801929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.802199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] PATH_INFO: `/v3/projects/ca9301f0506746d5a86bfdcb4e2fa939/users/425e255f196748a4a26479f2f39d2f3c/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.824071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca9301f0506746d5a86bfdcb4e2fa939, user_id=425e255f196748a4a26479f2f39d2f3c, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:34.824071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b76ea-9126-4d01-b8b3-5d258f79a6bb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:34.843715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d618a085-8bd4-412e-9b4d-15c4ea251938 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:34.844073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 964/1914] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:34 2022] PUT /identity/v3/projects/ca9301f0506746d5a86bfdcb4e2fa939/users/425e255f196748a4a26479f2f39d2f3c/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:34.855504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.856207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.857079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.898241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] MFA Rules not processed for user `425e255f196748a4a26479f2f39d2f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:34.900028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:34.946959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:34.949551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:34.949910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:34.950379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:34.963894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:35.063349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.065326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.103213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 951/1915] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:35.115609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 965/1916] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:35.120028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.135194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:35.283386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ff3a-b84e-4712-b8a3-e1aa97648205 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.289657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.291982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.292333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.292790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.293514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.297989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.393584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 952/1917] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:35 2022] POST /identity/v3/projects => generated 387 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:35.395345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.410304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261a760-2f15-4c22-8f0d-caf812409eaa None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.519424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:35.539121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.541225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.541225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.542084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.542084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.547093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.571640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 966/1918] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:35 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:35.576427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.600995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed1e806-2b91-4e9c-9424-0b2ffcd98482 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.615870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.616728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.617153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.617571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.618419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.620967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa538d43-0420-4c2a-9f3d-bee7c270625a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.648065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 953/1919] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:35.652293 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.673716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f2706f-cdff-4919-8968-ae4211b682bd admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.688056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.689801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.692377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.693140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] PATH_INFO: `/v3/projects/f510f3c401824d5ebc438079e59a125b/users/4a20206451854fcebf30bcea0ba507fd/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.701967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319790-e66b-409f-8956-d1e7f26bb91a None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.702260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319790-e66b-409f-8956-d1e7f26bb91a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.702537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319790-e66b-409f-8956-d1e7f26bb91a None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.704965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 954/1920] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 04:54:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 04:54:35.716202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.717006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.717298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.735872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f510f3c401824d5ebc438079e59a125b, user_id=4a20206451854fcebf30bcea0ba507fd, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.739194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.777233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 967/1921] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:35 2022] PUT /identity/v3/projects/f510f3c401824d5ebc438079e59a125b/users/4a20206451854fcebf30bcea0ba507fd/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:35.780874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:35.782538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.783042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:35.901074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0b5a3-5357-42b1-9ac6-f6247ace3faa admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.906635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.907654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.908072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.908646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.910001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.912395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.925234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 968/1922] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:35.927334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 955/1923] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:35.929374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.942306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:35.943765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:35.945380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080968a-d71f-4668-9507-19f898206c92 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.952055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.953932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.954419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.955029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] PATH_INFO: `/v3/projects/f510f3c401824d5ebc438079e59a125b/users/4a20206451854fcebf30bcea0ba507fd/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.958298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f510f3c401824d5ebc438079e59a125b, user_id=4a20206451854fcebf30bcea0ba507fd, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.962529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adba6cf-26e5-4f66-92c8-bab8daebb4b9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.964060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841069-fbf1-47fc-86a0-cf50770ae235 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:35.974301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:35.975139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.975774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.976152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:35.984215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 969/1924] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:35 2022] PUT /identity/v3/projects/f510f3c401824d5ebc438079e59a125b/users/4a20206451854fcebf30bcea0ba507fd/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:35.987347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:35.989028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:35.993552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:35.994236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:35.994916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.004544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 956/1925] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:36.030565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] MFA Rules not processed for user `4a20206451854fcebf30bcea0ba507fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.032279 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.118351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 970/1926] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:36.130588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.178042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.179733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.194955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3736c4-0948-42c3-a791-f4954a148adb service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.207519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:36.227395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:36.265273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.266220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.266565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.267740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.271538 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df668a9b-bb03-4d34-8680-08d8819ee876 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.278233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.279800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.279954 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.280625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.281290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] PATH_INFO: `/v3/users/c49abf539beb465aa392110f7701b809` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.281401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fbfea-7410-4b81-b1b4-b82242ee780f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.282836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c49abf539beb465aa392110f7701b809)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.285103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.295463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 957/1927] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:36.340906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c49abf539beb465aa392110f7701b809'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.341863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c49abf539beb465aa392110f7701b809'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.342737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c49abf539beb465aa392110f7701b809'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.351025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c49abf539beb465aa392110f7701b809'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.361083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c49abf539beb465aa392110f7701b809'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.384114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 971/1928] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:36 2022] DELETE /identity/v3/users/c49abf539beb465aa392110f7701b809 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:36.388398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.389433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.389433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.412987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.414237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.452241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.453709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.483166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 958/1929] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:36.494071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.495536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.527083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711665d-6679-4d71-98ba-c3db434657fa admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.532390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.533026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.533306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.533578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] PATH_INFO: `/v3/users/425e255f196748a4a26479f2f39d2f3c` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.534719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425e255f196748a4a26479f2f39d2f3c)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.536668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.553894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893a636-3772-4bda-9d87-8cef63831d6c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.558350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.559008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.559287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.559617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.570442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.571579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3400d64-8a57-4fa0-89b0-9648ceffc50e service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.584943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 959/1930] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:36.602096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425e255f196748a4a26479f2f39d2f3c'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.602815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425e255f196748a4a26479f2f39d2f3c'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.603894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425e255f196748a4a26479f2f39d2f3c'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.609717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:36.612771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425e255f196748a4a26479f2f39d2f3c'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.622126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425e255f196748a4a26479f2f39d2f3c'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:36.647854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 972/1931] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:36 2022] DELETE /identity/v3/users/425e255f196748a4a26479f2f39d2f3c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:36.653855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.654563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.654934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.680400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:36.681332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.761964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 960/1932] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:36.776355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.777961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:36.947359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57b081-7bdc-49ca-a9b9-c31944e43c77 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:36.952126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:36.952927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:36.953306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:36.953678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:36.966949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:36.969818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:36.984993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 973/1933] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:36.990743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:36.993023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.009154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:37.027671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ef2f4-b6d4-40c5-a28b-d06ccc6fbe96 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.059746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.059746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.059746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.059746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] PATH_INFO: `/v3/projects/f6dc6f31816145b3866b77f46477c088` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.060983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6dc6f31816145b3866b77f46477c088)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.062957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.151463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6dc6f31816145b3866b77f46477c088', 'request_id': 'req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.160320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6dc6f31816145b3866b77f46477c088', 'request_id': 'req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.168264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6dc6f31816145b3866b77f46477c088', 'request_id': 'req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.191139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] The token cache is being invalidate because project f6dc6f31816145b3866b77f46477c088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:37.191445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.192689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.197255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 961/1934] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:36 2022] DELETE /identity/v3/projects/f6dc6f31816145b3866b77f46477c088 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:37.202450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.221295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d7277-7836-402f-80d3-1af687fda86d service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.251967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.253820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.320378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.322648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.323524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.331653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] PATH_INFO: `/v3/users/6585aacc20b540f6a24468092e9080f0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.335311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6585aacc20b540f6a24468092e9080f0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.339195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.352847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3f194-d7a7-4b9d-bc13-7593cceb8ac8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.358615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.359368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.360044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.360420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.362944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.436088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6585aacc20b540f6a24468092e9080f0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.436722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6585aacc20b540f6a24468092e9080f0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.437598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6585aacc20b540f6a24468092e9080f0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.446727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6585aacc20b540f6a24468092e9080f0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.460167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6585aacc20b540f6a24468092e9080f0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.470485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:37.485471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 974/1935] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:37 2022] DELETE /identity/v3/users/6585aacc20b540f6a24468092e9080f0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:37.486546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.497121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.498459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.500295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.515755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 962/1936] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:37.605387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cfd07-614c-4d15-af25-36ae908bea0f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.611685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.612507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.612801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.613075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] PATH_INFO: `/v3/projects/ca9301f0506746d5a86bfdcb4e2fa939` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.614745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca9301f0506746d5a86bfdcb4e2fa939)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.617855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:37.744548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca9301f0506746d5a86bfdcb4e2fa939', 'request_id': 'req-0fcad608-202e-4b39-a398-52710948e602'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.753451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca9301f0506746d5a86bfdcb4e2fa939', 'request_id': 'req-0fcad608-202e-4b39-a398-52710948e602'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.768444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca9301f0506746d5a86bfdcb4e2fa939', 'request_id': 'req-0fcad608-202e-4b39-a398-52710948e602'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.789398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] The token cache is being invalidate because project ca9301f0506746d5a86bfdcb4e2fa939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:37.791252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.795722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:37.798546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 975/1937] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:37 2022] DELETE /identity/v3/projects/ca9301f0506746d5a86bfdcb4e2fa939 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:37.804370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:37.805971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:37.830389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a0f14-bad8-4cee-b2b8-f84570850050 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:37.893312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:37.919019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:37.920049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:37.920407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:37.920752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] PATH_INFO: `/v3/users/4a20206451854fcebf30bcea0ba507fd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:37.922228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a20206451854fcebf30bcea0ba507fd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:37.924545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:38.042003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a20206451854fcebf30bcea0ba507fd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:38.043305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a20206451854fcebf30bcea0ba507fd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:38.059387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a20206451854fcebf30bcea0ba507fd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:38.061600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a20206451854fcebf30bcea0ba507fd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:38.076884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a20206451854fcebf30bcea0ba507fd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:38.111132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 963/1938] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:37 2022] DELETE /identity/v3/users/4a20206451854fcebf30bcea0ba507fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:38.397065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:38.398814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:38.499395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcad608-202e-4b39-a398-52710948e602 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:38.586296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:38.615881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:38.616531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:38.616788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:38.617252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:38.619141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:38.757319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:38.759255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59421c3f-4d4a-4b64-b2c2-2f767847ab15 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:38.805689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 976/1939] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:38.836528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:38.838484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.014065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e05ba9-902b-403e-aa60-315b1eb6275e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.032952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.035035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.036454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.037170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] PATH_INFO: `/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.038719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78512c7929f34c1bbb2bb6201ff1ea22)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.041490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.135843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78512c7929f34c1bbb2bb6201ff1ea22', 'request_id': 'req-cf7eabe1-6326-4894-8427-b2f32a2911a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.144692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78512c7929f34c1bbb2bb6201ff1ea22', 'request_id': 'req-cf7eabe1-6326-4894-8427-b2f32a2911a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.154595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78512c7929f34c1bbb2bb6201ff1ea22', 'request_id': 'req-cf7eabe1-6326-4894-8427-b2f32a2911a7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.161671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:39.176770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] The token cache is being invalidate because project 78512c7929f34c1bbb2bb6201ff1ea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:39.177683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.179665 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf7eabe1-6326-4894-8427-b2f32a2911a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.184701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 964/1940] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:38 2022] DELETE /identity/v3/projects/78512c7929f34c1bbb2bb6201ff1ea22 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:39.186991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.187355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.187770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.217578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:39.219800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.334928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 977/1941] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:39.336833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.337163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.337505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.362796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:39.364359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.365677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.368695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.374834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 965/1942] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:39.379067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.385763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0860a2f-edea-495a-a050-4bd29637fec9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.390993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.391363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530ae1b-3351-4797-860c-eaee5a5098de None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.392006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.392285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.393774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] PATH_INFO: `/v3/projects/f510f3c401824d5ebc438079e59a125b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.395155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f510f3c401824d5ebc438079e59a125b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.398066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.398735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.399917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.400404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.401314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.402207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:39.402726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.405311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.431408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 966/1943] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:39.435680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.460390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97a1c32-8b6f-48e7-b8a9-acb4936b47f5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.496137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f510f3c401824d5ebc438079e59a125b', 'request_id': 'req-98fcec1d-b099-44d1-b787-213a3b55e2af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.511941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f510f3c401824d5ebc438079e59a125b', 'request_id': 'req-98fcec1d-b099-44d1-b787-213a3b55e2af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.528004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f510f3c401824d5ebc438079e59a125b', 'request_id': 'req-98fcec1d-b099-44d1-b787-213a3b55e2af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.548871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] The token cache is being invalidate because project f510f3c401824d5ebc438079e59a125b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:39.549503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.551786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-98fcec1d-b099-44d1-b787-213a3b55e2af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:39.558571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 978/1944] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:39 2022] DELETE /identity/v3/projects/f510f3c401824d5ebc438079e59a125b => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:39.563415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78b26-331c-4aaa-a88d-f4ac721a27e4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.563847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78b26-331c-4aaa-a88d-f4ac721a27e4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.564286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a78b26-331c-4aaa-a88d-f4ac721a27e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.599695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.600458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.600923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.601365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e1a78b26-331c-4aaa-a88d-f4ac721a27e4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:39.601844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.602704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.603754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e1a78b26-331c-4aaa-a88d-f4ac721a27e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.607577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.617409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 979/1945] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:39.626476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.626773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.627179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.638785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:39.652285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:39.654166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.658986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 967/1946] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:39.662919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.666996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:39.764437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ab971-1a49-4468-8fdc-e50ae936c70a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.770249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.771625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.772014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.772430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.773167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.776450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.822466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 968/1947] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/users => generated 292 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:39.829706 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.835227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 980/1948] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:39.837947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.862028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de267bd-a16c-4889-967e-63b4c9c617d6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.867413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdbc26-eddb-49f4-a1a1-c9a0a8bcb5aa None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.873450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.874267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.875006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.875292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.876172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:39.876477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.879195 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.906920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 981/1949] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:39.908058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.908827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.909229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.909647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.910949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.912191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.917204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.932713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd9cfe-a105-4af1-93d5-b5708a580eae admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.936168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 969/1950] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:39.946322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.947447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.947790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.948262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.949369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.950728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:39.960394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:39.970346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47959-3ef3-461d-81ad-ccd959b2cc5c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:39.977581 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:39.978267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:39.978552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:39.979021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:39.979697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:39.981629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.006913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 970/1951] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:40.014993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.038309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a96a2-e338-48e9-af3a-e84a965c2caf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.045225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 982/1952] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:39 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:40.049020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.064707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.154350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.155645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.155926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.156203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] PATH_INFO: `/v3/projects/499d916d1f5740ac88ab16e03389925f/users/4315b50bc2984e93804882ee6c7dead8/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.188059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499d916d1f5740ac88ab16e03389925f, user_id=4315b50bc2984e93804882ee6c7dead8, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.193672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce97b11-5cd3-4204-9bd3-c812f7014bc9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.226960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 971/1953] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:40 2022] PUT /identity/v3/projects/499d916d1f5740ac88ab16e03389925f/users/4315b50bc2984e93804882ee6c7dead8/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:40.248109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b490cd52-be6b-4b47-83b9-6346d1fc5a73 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.251591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.252802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.253187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.318673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] MFA Rules not processed for user `4315b50bc2984e93804882ee6c7dead8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:40.319942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:40.395592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.396471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.397225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.398830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.400976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.411563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.421260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 972/1954] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:40.428170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.446012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 983/1955] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:40.450382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.451565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efbd69b-9061-4eda-a90f-25fd656a3041 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.468687 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.469355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.469782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.470373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0c28d-0a34-431c-a0f6-210352c68766 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.470653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.471322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.473886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.476402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.477374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.477823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.478287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.479263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.481238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.491314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.511645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 984/1956] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:40.515208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.525430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 973/1957] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:40.529363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d50578-0a14-49b6-8607-db1b24582818 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.530881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.629073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.630080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.630369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.630742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.631398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.633552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.650702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c333ddcc-4898-4b50-82c7-512202594691 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.657045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.657704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.657985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.658267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.659073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.661225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.674761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 985/1958] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:40.676712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.704811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 974/1959] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:40.708132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79d0bd-8374-4d18-b8c9-d6bef0c5273c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.709010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.715510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.720963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.721659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.721946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.722227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] PATH_INFO: `/v3/projects/276bebcd1dd246b0b8fd554ef94e4c17/users/e0b0f7dc15ec4b4e9a95258d90fa0360/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.724147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb9311-e6d8-4cdc-9acc-24b1ac3fd829 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.734506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.735230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.735634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.736052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.737483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.740844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.746056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=276bebcd1dd246b0b8fd554ef94e4c17, user_id=e0b0f7dc15ec4b4e9a95258d90fa0360, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.749602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1240a4-8b2c-4a72-9742-613a3d85cfb9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.753923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 975/1960] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:40.759605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.771561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 986/1961] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:40 2022] PUT /identity/v3/projects/276bebcd1dd246b0b8fd554ef94e4c17/users/e0b0f7dc15ec4b4e9a95258d90fa0360/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:40.772223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad291d-9a7c-45c3-bed6-054b1a4648a4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.781914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.782194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.782469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.814684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] MFA Rules not processed for user `e0b0f7dc15ec4b4e9a95258d90fa0360`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:40.816559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:40.848025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.848727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.849012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.849288 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] PATH_INFO: `/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1/users/7b54d67f8c8641b390a6838d356a0d16/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.865813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a33ff0c5884cf78e02a6f0b269c5a1, user_id=7b54d67f8c8641b390a6838d356a0d16, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.868749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.883957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 976/1962] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:40 2022] PUT /identity/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1/users/7b54d67f8c8641b390a6838d356a0d16/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:40.888845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.895233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 987/1963] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:40.900056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:40.912004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79aa59-6c29-4586-a37f-f33b8cfd4020 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.969575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3511ea53-11ca-4831-be7f-56c59592546c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:40.974343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.974900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:40.975233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.975543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.975817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.976458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.978210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.985282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:40.986328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:40.986678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:40.987645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:40.990981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 977/1964] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:40 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:40.991907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:40.993990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329abd9-0854-41e6-8fb6-605df1b9a25c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:40.995021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.007704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce07d9-68ed-47f0-8293-85f1d6a63786 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.012587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.013299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.013579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.013856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] PATH_INFO: `/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1/users/7b54d67f8c8641b390a6838d356a0d16/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.016766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a33ff0c5884cf78e02a6f0b269c5a1, user_id=7b54d67f8c8641b390a6838d356a0d16, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.019053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.032437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 978/1965] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:40 2022] PUT /identity/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1/users/7b54d67f8c8641b390a6838d356a0d16/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:41.042148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 988/1966] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:40 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:41.043307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.045321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.045823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.046173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.086722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] MFA Rules not processed for user `7b54d67f8c8641b390a6838d356a0d16`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:41.088787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:41.164722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:41.169354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc284aa-2038-47ed-bdd5-68cf36ca208e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.223392 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 989/1967] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:41.237800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.239219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:41.250593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.250794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.251151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.251533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.252287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.254334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.284948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 979/1968] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:41 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:41.304611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.318746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35bb3c-c731-47ae-a603-86a2d6f819d2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.324570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2a11f-cdad-4bea-9b62-84d3a5c907d9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.328124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.328859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.329234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.329604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.330600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.330734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.331215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.331530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.331815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.333578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.347918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.349527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.366495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 980/1969] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:41.368069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.374285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 990/1970] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:41.391662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c2d52-9904-431d-9651-ac7d022a2ae7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.407642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.408367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.408747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.409138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.409944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.411843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.426333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 981/1971] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:41.430435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.451562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928e6aa-b230-413d-b265-b8ecb60438f6 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.467089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.468465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.469937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.470236 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] PATH_INFO: `/v3/projects/16296fe031bf409aba9bb9612cb74d29/users/4cbe08f1c0ee415ab10cca645671117c/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.498908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16296fe031bf409aba9bb9612cb74d29, user_id=4cbe08f1c0ee415ab10cca645671117c, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.507731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bb5ca-2431-4363-8453-76001e69979a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.540830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.556415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 991/1972] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:41 2022] PUT /identity/v3/projects/16296fe031bf409aba9bb9612cb74d29/users/4cbe08f1c0ee415ab10cca645671117c/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:41.558021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dae59-04e6-4bd0-aa07-a5b7e8d5aea8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.567303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.568347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.568874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.649769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] MFA Rules not processed for user `4cbe08f1c0ee415ab10cca645671117c`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:41.651017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:41.716843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.717536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.717876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.718156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.731011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:41.792048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 992/1973] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:41.798568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:41.852841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.857265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:41.879450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 982/1974] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:41.928911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407b43f-b1ac-413e-822a-fa26fbb82c26 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:41.942125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:41.942639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:41.942923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:41.943198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:41.945846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:41.957457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.032032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 993/1975] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:41 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:42.032114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.047192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5d7c4-cd48-44e9-8fd1-40f50f0bbab7 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.097927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:42.150529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.151292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.151664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.151939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.152712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.155733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.184121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 983/1976] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:42 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:42.197521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.210355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd767cd-ce5e-46b4-b195-2fee7750d486 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.216549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.217170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.217481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.217885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.218539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.220093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.238897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 994/1977] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:42.245482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.254144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f347b-c79e-4334-9fe5-59b3fa684b32 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.261891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.262699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.263045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.263387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] PATH_INFO: `/v3/projects/020ca9825613466bab2f98a6cde63e86/users/dbebcdb0c57746ac8e48d1c3b9c93f7b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.282411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020ca9825613466bab2f98a6cde63e86, user_id=dbebcdb0c57746ac8e48d1c3b9c93f7b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.285262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.305666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 984/1978] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:42 2022] PUT /identity/v3/projects/020ca9825613466bab2f98a6cde63e86/users/dbebcdb0c57746ac8e48d1c3b9c93f7b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:42.310498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.323450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ecc3b-89bf-4b2e-9a7f-f2683bb8ea82 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.352983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.399751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.400375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.400656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.401116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.401800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.404490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.417174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 995/1979] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:42.422166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.433179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f36ad11-1beb-4140-a86b-671c715c91e9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.433804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4bc2e4-2e9f-47e5-bf91-07c5ba3cb5ba admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.442137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.442796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.443087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.443205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.443375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] PATH_INFO: `/v3/users/4315b50bc2984e93804882ee6c7dead8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.443814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.444093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.444368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] PATH_INFO: `/v3/projects/020ca9825613466bab2f98a6cde63e86/users/dbebcdb0c57746ac8e48d1c3b9c93f7b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.444512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4315b50bc2984e93804882ee6c7dead8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.446396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020ca9825613466bab2f98a6cde63e86, user_id=dbebcdb0c57746ac8e48d1c3b9c93f7b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.446499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.449138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d3eee6-fc91-47c9-84ac-c30c0b5172b2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.462707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 996/1980] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:42 2022] PUT /identity/v3/projects/020ca9825613466bab2f98a6cde63e86/users/dbebcdb0c57746ac8e48d1c3b9c93f7b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:42.473757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.473948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.474245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.500987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4315b50bc2984e93804882ee6c7dead8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:42.501695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4315b50bc2984e93804882ee6c7dead8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:42.509405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] MFA Rules not processed for user `dbebcdb0c57746ac8e48d1c3b9c93f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:42.510132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4315b50bc2984e93804882ee6c7dead8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:42.510875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4315b50bc2984e93804882ee6c7dead8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:42.511060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:42.518858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e0dc2905-53fc-4d90-9105-e6b62aec57b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4315b50bc2984e93804882ee6c7dead8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:42.538511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:42.544461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 985/1981] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:42 2022] DELETE /identity/v3/users/4315b50bc2984e93804882ee6c7dead8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:42.549199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.549485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.549760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.569552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:42.570813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:42.576803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:42.616268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 997/1982] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:42.627799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.629508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:42.654933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 986/1983] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:42.662779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:42.664400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:42.713746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdcb07-6820-4318-b33b-f3df3262ffce None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.761195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d49b-bafe-439c-a9e1-882a6b0279dd None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:42.766008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.766912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.767397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.767926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.778970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.780801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.788795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:42.789394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:42.789678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:42.789947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:42.792118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:42.796769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 987/1984] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:42.878884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:42.880491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:42.891663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 998/1985] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:43.198652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:43.200941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:43.228772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea793e-6aac-4fe3-9c3b-994bbffccb21 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:43.253897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:43.255204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:43.255204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:43.255204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] PATH_INFO: `/v3/projects/499d916d1f5740ac88ab16e03389925f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:43.259714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=499d916d1f5740ac88ab16e03389925f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:43.264989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:43.358181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499d916d1f5740ac88ab16e03389925f', 'request_id': 'req-66367b03-c54b-4234-941d-0d18ebf35f5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.399361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499d916d1f5740ac88ab16e03389925f', 'request_id': 'req-66367b03-c54b-4234-941d-0d18ebf35f5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.412643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499d916d1f5740ac88ab16e03389925f', 'request_id': 'req-66367b03-c54b-4234-941d-0d18ebf35f5a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.453519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] The token cache is being invalidate because project 499d916d1f5740ac88ab16e03389925f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:43.454031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.454938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.459699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 988/1986] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:43 2022] DELETE /identity/v3/projects/499d916d1f5740ac88ab16e03389925f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:43.463633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:43.478673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf79068-3442-4d19-b3c3-047c7e923bcd service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:43.500505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:43.502168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:43.542321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:43.585294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:43.586010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:43.586660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:43.586943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:43.587219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] PATH_INFO: `/v3/users/7b54d67f8c8641b390a6838d356a0d16` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:43.588780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b54d67f8c8641b390a6838d356a0d16)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:43.592499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:43.629680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66367b03-c54b-4234-941d-0d18ebf35f5a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:43.634935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:43.635628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:43.636041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:43.636331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] PATH_INFO: `/v3/users/1eaab405c8f64891ba51a9f330d5ace9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:43.638327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eaab405c8f64891ba51a9f330d5ace9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:43.642854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:43.677437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b54d67f8c8641b390a6838d356a0d16'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.678364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b54d67f8c8641b390a6838d356a0d16'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.679128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b54d67f8c8641b390a6838d356a0d16'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.690459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b54d67f8c8641b390a6838d356a0d16'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.702017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-a17ed5b0-9ccf-4431-b8d3-8bee6b4c0ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b54d67f8c8641b390a6838d356a0d16'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.724978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 999/1987] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:43 2022] DELETE /identity/v3/users/7b54d67f8c8641b390a6838d356a0d16 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:43.738103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eaab405c8f64891ba51a9f330d5ace9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.739058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eaab405c8f64891ba51a9f330d5ace9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.753688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eaab405c8f64891ba51a9f330d5ace9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.754782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eaab405c8f64891ba51a9f330d5ace9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.768333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eaab405c8f64891ba51a9f330d5ace9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:43.799230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 989/1988] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:43 2022] DELETE /identity/v3/users/1eaab405c8f64891ba51a9f330d5ace9 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:43.802510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:43.802510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:43.802510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:43.825857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:43.827218 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:43.912657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1000/1989] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:43.923496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:43.925059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:43.995637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7e624-891c-46e3-b51c-d1db38734a9a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.000109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.000732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.001016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.001295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.011433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.013351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8a36b-519a-4e97-bbd2-19c0f2d1c5fa service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.025671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 990/1990] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:44.234035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.236680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.267893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eeb8c1-19c0-4ef6-a562-22699f0ba63e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.273082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.273732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.274014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.274288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] PATH_INFO: `/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.275558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a33ff0c5884cf78e02a6f0b269c5a1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.277482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.334034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:44.338990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a33ff0c5884cf78e02a6f0b269c5a1', 'request_id': 'req-0f35d55a-1380-4189-9f4d-d6799001fb1a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.346863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a33ff0c5884cf78e02a6f0b269c5a1', 'request_id': 'req-0f35d55a-1380-4189-9f4d-d6799001fb1a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.355922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a33ff0c5884cf78e02a6f0b269c5a1', 'request_id': 'req-0f35d55a-1380-4189-9f4d-d6799001fb1a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.368571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] The token cache is being invalidate because project f0a33ff0c5884cf78e02a6f0b269c5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:44.368952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.369671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.371589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1001/1991] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:44 2022] DELETE /identity/v3/projects/f0a33ff0c5884cf78e02a6f0b269c5a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:44.379031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.379031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.379031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.380003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.381609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.398414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:44.399821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.471835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35d55a-1380-4189-9f4d-d6799001fb1a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.477215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.477858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.478135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.478404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] PATH_INFO: `/v3/users/3df8e2cf8858431e8306cf6bc604df89` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.479752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3df8e2cf8858431e8306cf6bc604df89)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.482191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.482324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:44.500319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 991/1992] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:44.500319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.503749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.525166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca0573-bacb-491a-9a70-764f15a02ba9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.532895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.533593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.533870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.534184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] PATH_INFO: `/v3/projects/932e162ee57b4127ad46904509d82642` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.536250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932e162ee57b4127ad46904509d82642)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.538264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.547653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3df8e2cf8858431e8306cf6bc604df89'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.548486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3df8e2cf8858431e8306cf6bc604df89'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.549360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3df8e2cf8858431e8306cf6bc604df89'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.573187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3df8e2cf8858431e8306cf6bc604df89'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.590190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1aa6d277-dad8-407b-9e1a-7f0a5830d4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3df8e2cf8858431e8306cf6bc604df89'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.605492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932e162ee57b4127ad46904509d82642', 'request_id': 'req-8316f876-4726-4edd-8f36-54337115a409'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.615157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932e162ee57b4127ad46904509d82642', 'request_id': 'req-8316f876-4726-4edd-8f36-54337115a409'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.623817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932e162ee57b4127ad46904509d82642', 'request_id': 'req-8316f876-4726-4edd-8f36-54337115a409'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.628786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1002/1993] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:44 2022] DELETE /identity/v3/users/3df8e2cf8858431e8306cf6bc604df89 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:44.630281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.630629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.631970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.647403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] The token cache is being invalidate because project 932e162ee57b4127ad46904509d82642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:44.647532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.648213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8316f876-4726-4edd-8f36-54337115a409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.650112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 992/1994] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:44 2022] DELETE /identity/v3/projects/932e162ee57b4127ad46904509d82642 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:44.651337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.651655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.651933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.662558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:44.663825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.677143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:44.678427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.725971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:44.748385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1003/1995] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:44.752324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.754369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.761201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 993/1996] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:44.761201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.761201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.771881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff63439c-111d-4bd4-9ce1-a8dc4fbc1123 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.776856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.777568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.778697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.779058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] PATH_INFO: `/v3/users/5a47f816ba4441388a0ef25ba25ad6a3` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.784029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a47f816ba4441388a0ef25ba25ad6a3)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.786049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.848547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a6721-10b2-46df-868f-b3d3d3802756 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:44.853143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:44.853762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:44.854041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:44.854313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:44.857209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.860742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a47f816ba4441388a0ef25ba25ad6a3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.861431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a47f816ba4441388a0ef25ba25ad6a3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.862497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a47f816ba4441388a0ef25ba25ad6a3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.871400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a47f816ba4441388a0ef25ba25ad6a3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.880579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a47f816ba4441388a0ef25ba25ad6a3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:44.902740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1004/1997] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:44 2022] DELETE /identity/v3/users/5a47f816ba4441388a0ef25ba25ad6a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:44.906317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.906317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:44.912970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:44.944268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:44.945833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:44.957251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 994/1998] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:44.958234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:44.959966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.039302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b54938-83ae-48fb-8504-093328c6924c service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.117717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04faa593-8e4d-411b-8fd0-8c041a8baa38 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.132849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.133693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.133814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.134043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.135080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:45.135402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.140529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.160802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.164326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.164650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.165174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.170178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1005/1999] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:45.170501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.174451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.203971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ee14a-48bd-461b-899d-64620242f29f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.210558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.212268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.218923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.220260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.220260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.220425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.221657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.223622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.239936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 995/2000] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:45.279304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1006/2001] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:45 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:45.283936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.295966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c846cd-7d0b-4b84-91b5-a27df007dc5d service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.426952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.427614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.428572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.428855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.429651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.433530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.484576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 996/2002] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:45 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:45.488444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.504057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e6a32-cc8c-4083-92d6-77188418752f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.524968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.525723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.526076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.526622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.527351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.532211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.549816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1007/2003] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:45.553749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.565696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d75f0-91f9-494f-9079-c43bbd10e250 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.570884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.571600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.571943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.572785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.573282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.574939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.597601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 997/2004] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:45.599181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.616464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c99f2d-7d25-4705-b92d-e1ac16054705 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.632072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.633013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.634381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.634855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] PATH_INFO: `/v3/projects/8e73b319a97a4cf0a95e7b1f9cd3e673/users/084f2df437124a1f98d069d21b25c666/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.653643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e73b319a97a4cf0a95e7b1f9cd3e673, user_id=084f2df437124a1f98d069d21b25c666, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.657027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d94b56-bcfd-4cea-972a-dc60be519ec7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.675800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:45.683748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.686086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1008/2005] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:45 2022] PUT /identity/v3/projects/8e73b319a97a4cf0a95e7b1f9cd3e673/users/084f2df437124a1f98d069d21b25c666/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:45.697790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.698086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.698433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.701013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.725122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed119390-2b84-4929-a33e-820c7a6a237f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.760779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] MFA Rules not processed for user `084f2df437124a1f98d069d21b25c666`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:45.762012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.777675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:45.850652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.851593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.852353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.852799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] PATH_INFO: `/v3/projects/4ad1f8c344644575924943c8619b55bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.866086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ad1f8c344644575924943c8619b55bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.868472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.899441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1009/2006] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:45.900466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.902207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.917578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92834f88-aaa9-4d70-aebc-6923a089d9f3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:45.925395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:45.925636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:45.925995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:45.926346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] PATH_INFO: `/v3/projects/25797f4c3e46410abaec97dab9ee90f1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:45.927735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] RBAC: Authorizing `identity:delete_project(project_id=25797f4c3e46410abaec97dab9ee90f1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:45.929670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:45.945635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ad1f8c344644575924943c8619b55bd', 'request_id': 'req-d8842400-eab1-4271-a576-86e1e53b9d68'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:45.952957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ad1f8c344644575924943c8619b55bd', 'request_id': 'req-d8842400-eab1-4271-a576-86e1e53b9d68'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:45.960094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ad1f8c344644575924943c8619b55bd', 'request_id': 'req-d8842400-eab1-4271-a576-86e1e53b9d68'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:45.978805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] The token cache is being invalidate because project 4ad1f8c344644575924943c8619b55bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:45.979311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:45.980102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:45.982320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 998/2007] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:45 2022] DELETE /identity/v3/projects/4ad1f8c344644575924943c8619b55bd => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:45.983420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:45.985869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:45.991640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25797f4c3e46410abaec97dab9ee90f1', 'request_id': 'req-df303d71-b258-4094-a22c-5274f2f5849f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.002089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25797f4c3e46410abaec97dab9ee90f1', 'request_id': 'req-df303d71-b258-4094-a22c-5274f2f5849f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.010492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25797f4c3e46410abaec97dab9ee90f1', 'request_id': 'req-df303d71-b258-4094-a22c-5274f2f5849f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.028777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] The token cache is being invalidate because project 25797f4c3e46410abaec97dab9ee90f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:46.029144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.029916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.031582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1010/2008] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:45 2022] DELETE /identity/v3/projects/25797f4c3e46410abaec97dab9ee90f1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:46.034921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.036846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.060845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8842400-eab1-4271-a576-86e1e53b9d68 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.113306 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303d71-b258-4094-a22c-5274f2f5849f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.118586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.118732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:46.119203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.119495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.119965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.122303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.131576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.132765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.133247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.133589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.134281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.137120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.155656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:46.176179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 999/2009] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:45 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:46.176179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.178245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.203217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.204733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.216091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1011/2010] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:46.217286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.219515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.234480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0c6b57-047b-4b88-ac63-2b729e9382f3 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.255241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b92799-3557-42bc-b55e-d9d06c4e548d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.263320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.264213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.264604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.264985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] PATH_INFO: `/v3/users/43b9c63c1d54409e9f21334999feed1d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.266790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43b9c63c1d54409e9f21334999feed1d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.269724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.330219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.330887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.331168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.331439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] PATH_INFO: `/v3/users/b6aa1482fbbf4d24b01d7d792f2ce5c7` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.332811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6aa1482fbbf4d24b01d7d792f2ce5c7)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.334937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.349310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43b9c63c1d54409e9f21334999feed1d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.350299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43b9c63c1d54409e9f21334999feed1d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.366330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43b9c63c1d54409e9f21334999feed1d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.367516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43b9c63c1d54409e9f21334999feed1d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.381449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43b9c63c1d54409e9f21334999feed1d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.407685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1000/2011] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:46 2022] DELETE /identity/v3/users/43b9c63c1d54409e9f21334999feed1d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:46.410668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.410668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.435353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6aa1482fbbf4d24b01d7d792f2ce5c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.436248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6aa1482fbbf4d24b01d7d792f2ce5c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.438781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6aa1482fbbf4d24b01d7d792f2ce5c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.467497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6aa1482fbbf4d24b01d7d792f2ce5c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.480113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6aa1482fbbf4d24b01d7d792f2ce5c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:46.545993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1012/2012] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:46 2022] DELETE /identity/v3/users/b6aa1482fbbf4d24b01d7d792f2ce5c7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:46.634867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:46.641063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea6034-bea7-481f-8ce0-acabc3567201 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.738556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.739312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.739701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.739987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.740623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.742587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.771067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1001/2013] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:46 2022] POST /identity/v3/users => generated 299 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:46.771450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.773108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:46.789355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f8574-6625-4f70-ad47-64c86a7dbffd admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.796533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.797427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.797828 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.798661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.800374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.801816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.815555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1013/2014] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:46.820053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.837848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b50d1c-7dd9-4156-ba30-1f7133878736 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.844097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:46.845711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:46.845711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:46.845711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] PATH_INFO: `/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac/users/fa5f7e9fc6fd499ea375437961972ec7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:46.892838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ff6e3b5b0e42da9e79f8f20b03e3ac, user_id=fa5f7e9fc6fd499ea375437961972ec7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:46.895740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:46.922526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1002/2015] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:46 2022] PUT /identity/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac/users/fa5f7e9fc6fd499ea375437961972ec7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:46.927016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.940976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8516c-a172-4ace-a874-847da0a6698f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:46.984354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:46.994948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:46.998095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.052818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.054238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.054238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.054238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.055111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.057420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.081004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1014/2016] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:47.082247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.099222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53c5d5-4069-46d8-9d39-e680989fff29 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.112234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.112905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.113189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.113462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] PATH_INFO: `/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac/users/fa5f7e9fc6fd499ea375437961972ec7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.115030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622db2f-34cd-4462-97c5-dca9079da201 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.116947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31ff6e3b5b0e42da9e79f8f20b03e3ac, user_id=fa5f7e9fc6fd499ea375437961972ec7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.120139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.129758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.131920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.132412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.132588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] PATH_INFO: `/v3/projects/a4d119bc2d86443a848f416d557a05aa` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.133786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4d119bc2d86443a848f416d557a05aa)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.136022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.138432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1015/2017] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:47 2022] PUT /identity/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac/users/fa5f7e9fc6fd499ea375437961972ec7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:47.143837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.146746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.198595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4d119bc2d86443a848f416d557a05aa', 'request_id': 'req-15660995-73dd-4516-821e-ff2601e9cb41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.206379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4d119bc2d86443a848f416d557a05aa', 'request_id': 'req-15660995-73dd-4516-821e-ff2601e9cb41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.212392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4d119bc2d86443a848f416d557a05aa', 'request_id': 'req-15660995-73dd-4516-821e-ff2601e9cb41'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.222204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.227064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] The token cache is being invalidate because project a4d119bc2d86443a848f416d557a05aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:47.227351 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.228209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-15660995-73dd-4516-821e-ff2601e9cb41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.229453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8fa19-6dff-49f5-9218-88b4cb883159 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.230045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1003/2018] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:46 2022] DELETE /identity/v3/projects/a4d119bc2d86443a848f416d557a05aa => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:47.231349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dde4d-0212-4bf6-8d68-b026151625dc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.231674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dde4d-0212-4bf6-8d68-b026151625dc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.232417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dde4d-0212-4bf6-8d68-b026151625dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.264328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ab2dde4d-0212-4bf6-8d68-b026151625dc None None] MFA Rules not processed for user `fa5f7e9fc6fd499ea375437961972ec7`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.265533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ab2dde4d-0212-4bf6-8d68-b026151625dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.297486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.298132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.298407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.298672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] PATH_INFO: `/v3/projects/27c179a7c3374b32a9ddebadaf825a0a` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.299825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=27c179a7c3374b32a9ddebadaf825a0a)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.301756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.340044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1004/2019] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:47.341440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2259e-d37c-40ca-9c9b-84e4265aca62 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.341721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2259e-d37c-40ca-9c9b-84e4265aca62 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.341988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff2259e-d37c-40ca-9c9b-84e4265aca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.356853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27c179a7c3374b32a9ddebadaf825a0a', 'request_id': 'req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.362067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4ff2259e-d37c-40ca-9c9b-84e4265aca62 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.362449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27c179a7c3374b32a9ddebadaf825a0a', 'request_id': 'req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.363256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4ff2259e-d37c-40ca-9c9b-84e4265aca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.366068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.371429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27c179a7c3374b32a9ddebadaf825a0a', 'request_id': 'req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.385097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] The token cache is being invalidate because project 27c179a7c3374b32a9ddebadaf825a0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:47.385381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.386070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:47.387626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1016/2020] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:47 2022] DELETE /identity/v3/projects/27c179a7c3374b32a9ddebadaf825a0a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:47.391984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.391984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.428086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1005/2021] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:47.428490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08a95-9b79-4019-95cc-5f1aa8e46e12 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.428776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08a95-9b79-4019-95cc-5f1aa8e46e12 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.429055 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd08a95-9b79-4019-95cc-5f1aa8e46e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.449057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2dd08a95-9b79-4019-95cc-5f1aa8e46e12 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.454745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2dd08a95-9b79-4019-95cc-5f1aa8e46e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.455821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa75c-0ce9-448f-b90f-4eeedefee5bf admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.459449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.460214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.460492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.460759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.462032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1006/2022] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:47.462509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.463237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e22cc-5df8-4f58-99eb-e6b8b186c50d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.463644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e22cc-5df8-4f58-99eb-e6b8b186c50d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.463939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e22cc-5df8-4f58-99eb-e6b8b186c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.487027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6d9e22cc-5df8-4f58-99eb-e6b8b186c50d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.488281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6d9e22cc-5df8-4f58-99eb-e6b8b186c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.496295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1007/2023] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:47.497912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.498198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.498470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.518015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:47.519199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:47.529049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1008/2024] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:47.529867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.531798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.533435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.539780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6102538-dc13-4865-8063-f9028e6575c3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.543107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1017/2025] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:47.543957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.545564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.546174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.546463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.546739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.547680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:47.548150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.549890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.555102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f3bd89-adb1-4456-a393-c5bfe154ec4f service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.560819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.561413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.561678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.561946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.562586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:47.562882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.564737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.570484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1009/2026] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:47.575711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.594343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1018/2027] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:47.596666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a84d25-e9cd-4307-8ffc-3bae55b07883 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.598690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.611864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9215e-9db6-4540-8419-27d661f7a5b2 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.614382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.615015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.615289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.615595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.616340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.618232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.619818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.620821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.621206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.621634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.622456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.624943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.679227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1019/2028] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/projects => generated 409 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:47.689532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1010/2029] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:47.690176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.693598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.778414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.834043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd7cae-a60f-4f5d-a6bf-f47082d0af77 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.838244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0427214-e9f5-4e8b-bef3-2eb30864d9e4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.842879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.843929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.844410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.844992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.845239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.845530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.845639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.845820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.847753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.847895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.849171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.860370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.883248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1011/2030] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:47.884958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.906223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61686bc-5218-4fc2-83f7-91f6f1afbcaf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.907074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:47.916329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1020/2031] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:47 2022] POST /identity/v3/users => generated 305 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:47.916486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.916897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.917221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.917493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.919174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.919371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.921450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.943666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1012/2032] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:47.945388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5070893-3dad-4c66-9405-225b3a5ac68a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.946070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:47.959117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518ccf5-8cea-4f08-9d4e-5340a8a6f0b8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:47.967981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.969040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.969489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.970395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.970720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.972452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.974720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:47.977069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:47.977634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:47.978120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:47.984334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:47.988142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1013/2033] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:47.991778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:47.994441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.031981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c7e95-497a-4e27-8abb-47a0a9a4cefa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.048153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1021/2034] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:48.050072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.051501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.052092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.056119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.056119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] PATH_INFO: `/v3/projects/790cfda6305f4c71bdfe63a1d3fbba86/users/1be220c1e9f2400d971b67dc7380f8af/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.091533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ac82c-2fa7-43f4-8e4a-cc55fb27319b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.100260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.102646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.102950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.103800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.104463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.108940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.115056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=790cfda6305f4c71bdfe63a1d3fbba86, user_id=1be220c1e9f2400d971b67dc7380f8af, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.123277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc213c3-702d-4919-9eab-52232b1ce72d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.135146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1022/2035] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:48.139968 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.165461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1014/2036] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:47 2022] PUT /identity/v3/projects/790cfda6305f4c71bdfe63a1d3fbba86/users/1be220c1e9f2400d971b67dc7380f8af/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:48.173704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a5526-46c6-466f-9a39-c9b8e8113850 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.189916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.192486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.192859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.240198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] MFA Rules not processed for user `1be220c1e9f2400d971b67dc7380f8af`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:48.245792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.292342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.293272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.293583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.293852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] PATH_INFO: `/v3/projects/342c4a1aad4a4fcda55f9ae6a6790309/users/b8feb40088c8492da7fb39b91e52bd4a/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.314493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=342c4a1aad4a4fcda55f9ae6a6790309, user_id=b8feb40088c8492da7fb39b91e52bd4a, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.318308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c520be-4c69-44bd-9b9c-3fcc9ea9bbf5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.336889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1023/2037] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:48 2022] PUT /identity/v3/projects/342c4a1aad4a4fcda55f9ae6a6790309/users/b8feb40088c8492da7fb39b91e52bd4a/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:48.348225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.348502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.348770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.355998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1015/2038] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:48.367629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.370507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.387641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] MFA Rules not processed for user `b8feb40088c8492da7fb39b91e52bd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:48.389074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.445559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2e0ec-89e5-4f07-9b86-ebc0970735cf None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.482824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.501985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1024/2039] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:48 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:48.503093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.531328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.532014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.532296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.532572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.567174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.587267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cbfe1e-b559-4c06-b37f-d42cad979ccc None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.592997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.593613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.593889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.594451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.595079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.597309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.611304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.612899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.623416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1016/2040] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:48.628163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1025/2041] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:48 2022] POST /identity/v3/projects => generated 409 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:48.632018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.643431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0702430-f32f-41e9-85a9-841fdf7c50cf service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.657813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.708697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.709287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.709620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.709869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.710503 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.712557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.721876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064e71c-7334-41a7-b1df-7f4f4a024d97 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.728296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.729215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.729633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.730045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] PATH_INFO: `/v3/users/1be220c1e9f2400d971b67dc7380f8af` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.732070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be220c1e9f2400d971b67dc7380f8af)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.734596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.735372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1017/2042] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:48 2022] POST /identity/v3/users => generated 311 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:48.739171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.749766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e558657-a37b-4866-8981-f301c33e0a10 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.755287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.755970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.756251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.756525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.757169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.758737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.771670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1018/2043] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:48.775615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.788808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b2df0-be3b-41b4-9387-f2963b159715 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.795498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.796260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.796626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.796908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] PATH_INFO: `/v3/projects/57639b40b8de492bbf565b5a2a905d17/users/b757ca9b48ee40dda5350d57150ff3a1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.816721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57639b40b8de492bbf565b5a2a905d17, user_id=b757ca9b48ee40dda5350d57150ff3a1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.817524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be220c1e9f2400d971b67dc7380f8af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.818253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be220c1e9f2400d971b67dc7380f8af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.818892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be220c1e9f2400d971b67dc7380f8af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.819705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.833071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be220c1e9f2400d971b67dc7380f8af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.842796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1019/2044] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:48 2022] PUT /identity/v3/projects/57639b40b8de492bbf565b5a2a905d17/users/b757ca9b48ee40dda5350d57150ff3a1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:48.845638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8af4e7af-46d8-4c93-ba81-d53099e6413e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be220c1e9f2400d971b67dc7380f8af'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:48.847436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.849818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.869325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1026/2045] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:48 2022] DELETE /identity/v3/users/1be220c1e9f2400d971b67dc7380f8af => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:48.873906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.874194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.874471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.883391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.894622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:48.895871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.920567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315e92ef-8e4f-4ed5-b43d-23e9827a85a3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:48.945086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:48.959654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1027/2046] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:48.970936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:48.972348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:48.981276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:48.981892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:48.982178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:48.982451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:48.983089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:48.984748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:48.997546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1020/2047] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:49.000161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:49.010429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3591c4-1769-472d-9592-0356eb626e4a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.015847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.016495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.016781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.017060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] PATH_INFO: `/v3/projects/57639b40b8de492bbf565b5a2a905d17/users/b757ca9b48ee40dda5350d57150ff3a1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.018984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57639b40b8de492bbf565b5a2a905d17, user_id=b757ca9b48ee40dda5350d57150ff3a1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.022007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cd164-e2f9-4cf8-a2e0-ff85c7a85803 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.033611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1021/2048] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:48 2022] PUT /identity/v3/projects/57639b40b8de492bbf565b5a2a905d17/users/b757ca9b48ee40dda5350d57150ff3a1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:49.035573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63512fd4-6bc9-4f6e-8e97-7c7ef54c11dd None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.049855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.050405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.050758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.087129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] MFA Rules not processed for user `b757ca9b48ee40dda5350d57150ff3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:49.088533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.110240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.111181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.111814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.112180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.182204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1022/2049] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:49 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:49.189620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.190833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.201128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:49.203180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.208210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1028/2050] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:49.277891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:49.305183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bcb42-89dc-4829-92fb-0f314e87b6f3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.311209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.311209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.311209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.311524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.321686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.323461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.335513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1023/2051] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:49 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:49.560793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:49.573953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d6f62-db3d-4d6b-a3bc-417b30fb9abf service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.579299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.580074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.581041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.581398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.584410 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.744985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.751594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f683dd-875a-42a7-82f4-f82d463603b0 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.759946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:49.769183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1029/2052] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:49 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:49.821632 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:49.823974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:49.852312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a5d75-37a0-4c0d-9c44-10e6d0213e79 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:49.864155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:49.865008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:49.865416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:49.865771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] PATH_INFO: `/v3/projects/790cfda6305f4c71bdfe63a1d3fbba86` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:49.867223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=790cfda6305f4c71bdfe63a1d3fbba86)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:49.870273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:49.956313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790cfda6305f4c71bdfe63a1d3fbba86', 'request_id': 'req-9efc3e99-49a8-4af5-a32e-8da2b053a382'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:49.966454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790cfda6305f4c71bdfe63a1d3fbba86', 'request_id': 'req-9efc3e99-49a8-4af5-a32e-8da2b053a382'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:49.981800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790cfda6305f4c71bdfe63a1d3fbba86', 'request_id': 'req-9efc3e99-49a8-4af5-a32e-8da2b053a382'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:50.001474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] The token cache is being invalidate because project 790cfda6305f4c71bdfe63a1d3fbba86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:50.002247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:50.004120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-9efc3e99-49a8-4af5-a32e-8da2b053a382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:50.006372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1024/2053] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:49 2022] DELETE /identity/v3/projects/790cfda6305f4c71bdfe63a1d3fbba86 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:50.023072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.023072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.023072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.047801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:50.049025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:50.343821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1030/2054] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:50.357608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.357934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.358211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.402667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:50.405639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:50.443138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1025/2055] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:50.449106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.466832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b692200-922e-43b2-bb0a-805dd71e94d9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.475985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.475985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.475985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.475985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.476985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:50.476985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:50.487173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:50.540058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1031/2056] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:50.541131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.558098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a5672-bbfe-4ad3-a4ff-3c0f697bb099 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.569034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.569772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.570137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.570561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.571527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:50.574207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:50.651980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1026/2057] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:50 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:54:50.654946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.678335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a7595-c266-4b87-ada3-164a165bd75d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.773824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.776231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.776673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.777028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.777841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:50.781179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:50.820575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1032/2058] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:50 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:50.824932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.861017 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754d5cc-02bb-4a93-86bd-927775431a2c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.871657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.872315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.872652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.872907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.873551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:50.875124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:50.888364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1027/2059] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:50.892359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.906951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7a0b8-38ee-4dea-84d9-90db1f4a06bb admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.913737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.914401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.915373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.915755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.916581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:50.919183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ec3e36-2670-434c-a03c-64b7117eb6c8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:50.934072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1033/2060] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:50.937707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:50.950338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b68cf9-b223-460a-9a02-ebb544e612ff admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:50.956824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:50.957573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:50.957895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:50.958175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] PATH_INFO: `/v3/projects/74e738c71afb43958f6b8758a06bf8f1/users/23f26a8be62246d38f63884e08f382d0/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:50.995364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74e738c71afb43958f6b8758a06bf8f1, user_id=23f26a8be62246d38f63884e08f382d0, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:51.001657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:51.037016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1028/2061] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:50 2022] PUT /identity/v3/projects/74e738c71afb43958f6b8758a06bf8f1/users/23f26a8be62246d38f63884e08f382d0/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:51.038725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:51.039777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:51.040252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:51.095658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] MFA Rules not processed for user `23f26a8be62246d38f63884e08f382d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:51.096921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:51.196352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:51.209190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1034/2062] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:51.228964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:51.232590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:51.232732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:51.234069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:51.306122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ca810-b374-4283-a544-7ac13c6e34ca None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:51.310101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:51.310847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:51.311159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:51.311546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:51.314318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69e5a-74eb-4720-91ae-fde6179f803b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:51.320272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:51.321075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:51.321419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:51.321571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:51.322096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] PATH_INFO: `/v3/users/e0b0f7dc15ec4b4e9a95258d90fa0360` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:51.323048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a934a3e-579d-4398-b3b3-2bd5677cee7e service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:51.323640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0b0f7dc15ec4b4e9a95258d90fa0360)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:51.326433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:51.334551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:51.334783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1035/2063] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:51.400642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0b0f7dc15ec4b4e9a95258d90fa0360'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:51.401352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0b0f7dc15ec4b4e9a95258d90fa0360'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:51.413609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0b0f7dc15ec4b4e9a95258d90fa0360'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:51.414544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0b0f7dc15ec4b4e9a95258d90fa0360'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:51.426819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0b0f7dc15ec4b4e9a95258d90fa0360'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:51.447549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1029/2064] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:51 2022] DELETE /identity/v3/users/e0b0f7dc15ec4b4e9a95258d90fa0360 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:51.455782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:51.455782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:51.455782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:51.473399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:51.474635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:51.551211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1036/2065] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:51.564539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:51.566552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:51.653370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f68d22-7c75-472d-81b4-50882fe7bd9e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:51.658068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:51.659285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:51.659937 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:51.660909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:51.680593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:51.684600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:51.697379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1030/2066] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:54:52.261690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:52.264130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:52.278468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d8e9d-9c8d-4d28-bd1a-8fd0936bf7a6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:52.284596 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:52.285322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:52.285696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:52.286007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] PATH_INFO: `/v3/projects/276bebcd1dd246b0b8fd554ef94e4c17` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:52.287549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] RBAC: Authorizing `identity:delete_project(project_id=276bebcd1dd246b0b8fd554ef94e4c17)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:52.289861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:52.350717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '276bebcd1dd246b0b8fd554ef94e4c17', 'request_id': 'req-7df420c8-813b-4cee-beef-7c4b6361698d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.358455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '276bebcd1dd246b0b8fd554ef94e4c17', 'request_id': 'req-7df420c8-813b-4cee-beef-7c4b6361698d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.367352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '276bebcd1dd246b0b8fd554ef94e4c17', 'request_id': 'req-7df420c8-813b-4cee-beef-7c4b6361698d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.381160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] The token cache is being invalidate because project 276bebcd1dd246b0b8fd554ef94e4c17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:52.381527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.382264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.384132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1037/2067] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:52 2022] DELETE /identity/v3/projects/276bebcd1dd246b0b8fd554ef94e4c17 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:52.388038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:52.397810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1aa1b-2e55-4a39-ac8c-04842c8a8db3 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:52.470682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:52.471320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:52.471628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:52.471900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] PATH_INFO: `/v3/users/4cbe08f1c0ee415ab10cca645671117c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:52.473609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cbe08f1c0ee415ab10cca645671117c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:52.475533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:52.520534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:52.540475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cbe08f1c0ee415ab10cca645671117c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.541336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cbe08f1c0ee415ab10cca645671117c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.552094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cbe08f1c0ee415ab10cca645671117c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.553069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cbe08f1c0ee415ab10cca645671117c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.564004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cbe08f1c0ee415ab10cca645671117c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:52.612579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1031/2068] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:52 2022] DELETE /identity/v3/users/4cbe08f1c0ee415ab10cca645671117c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:53.076605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:53.079507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:53.123442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df420c8-813b-4cee-beef-7c4b6361698d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:53.188831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:53.297915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:53.299462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:53.300000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:53.300585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] PATH_INFO: `/v3/projects/16296fe031bf409aba9bb9612cb74d29` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:53.302201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16296fe031bf409aba9bb9612cb74d29)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:53.304854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:53.405154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16296fe031bf409aba9bb9612cb74d29', 'request_id': 'req-e09f1b6c-669d-4705-abac-88bd0c580f77'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.417301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16296fe031bf409aba9bb9612cb74d29', 'request_id': 'req-e09f1b6c-669d-4705-abac-88bd0c580f77'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.439233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16296fe031bf409aba9bb9612cb74d29', 'request_id': 'req-e09f1b6c-669d-4705-abac-88bd0c580f77'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.462329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] The token cache is being invalidate because project 16296fe031bf409aba9bb9612cb74d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:53.463187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.464954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.467845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1038/2069] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:53 2022] DELETE /identity/v3/projects/16296fe031bf409aba9bb9612cb74d29 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:53.472543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:53.475246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:53.507749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14321d15-5d17-4a3b-a1f4-1ca1824a63c2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:53.590188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:53.590925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:53.591209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:53.591579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] PATH_INFO: `/v3/users/dbebcdb0c57746ac8e48d1c3b9c93f7b` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:53.592661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbebcdb0c57746ac8e48d1c3b9c93f7b)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:53.594722 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:53.654470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbebcdb0c57746ac8e48d1c3b9c93f7b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.655181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbebcdb0c57746ac8e48d1c3b9c93f7b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.673726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbebcdb0c57746ac8e48d1c3b9c93f7b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.674350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbebcdb0c57746ac8e48d1c3b9c93f7b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.684775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbebcdb0c57746ac8e48d1c3b9c93f7b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:53.712461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1032/2070] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:53 2022] DELETE /identity/v3/users/dbebcdb0c57746ac8e48d1c3b9c93f7b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:54:53.820914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:53.823006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:53.912415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1b6c-669d-4705-abac-88bd0c580f77 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:53.984847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:53.985472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:53.985753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:53.986014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:53.987852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:54.015599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:54.069217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.070703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:54.101304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.103092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832204-3b51-450a-a1d2-3261c033bb97 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.117492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1039/2071] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:54.130214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:54.182463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75a89e-dbed-4a2e-ad2f-2399baa24068 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.190100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.191143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.191647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.192133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] PATH_INFO: `/v3/projects/020ca9825613466bab2f98a6cde63e86` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.193598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=020ca9825613466bab2f98a6cde63e86)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.195892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.281803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020ca9825613466bab2f98a6cde63e86', 'request_id': 'req-e5c83b1e-b693-4e0c-a716-94b4beb656dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:54.298647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020ca9825613466bab2f98a6cde63e86', 'request_id': 'req-e5c83b1e-b693-4e0c-a716-94b4beb656dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:54.305138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020ca9825613466bab2f98a6cde63e86', 'request_id': 'req-e5c83b1e-b693-4e0c-a716-94b4beb656dc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:54.331922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] The token cache is being invalidate because project 020ca9825613466bab2f98a6cde63e86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:54.332212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:54.332884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5c83b1e-b693-4e0c-a716-94b4beb656dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:54.337831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1033/2072] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:54 2022] DELETE /identity/v3/projects/020ca9825613466bab2f98a6cde63e86 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:54.339531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.340645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.340645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.363957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:54.365237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:54.441960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1040/2073] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:54.450097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.450463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.450693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.475801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:54.485540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:54.502645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1034/2074] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:54.507056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.518401 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecedbc2-e34d-476b-97fb-f09943117326 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.524018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.524753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.525040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.525381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.526117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:54.526482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.529070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.569230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1041/2075] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:54.572306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.586252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506627d8-6c2c-4152-bfac-a34d5a38394d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.598202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.598849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.599176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.599384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.600230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.602514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.655802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1035/2076] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:54 2022] POST /identity/v3/projects => generated 389 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:54.657894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.669019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522ebc6-ff47-460e-968c-f0192f914a44 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.734748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.735358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.735665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.735960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.736582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.738466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.759457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1042/2077] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:54 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:54.764141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.775885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef4bc5-7f11-4c20-962d-cb9419e80c13 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.782353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.783069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.783388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.783810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.787941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.789875 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.806521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1036/2078] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:54:54.812581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.823739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9f09b-d212-4f97-85d6-351a124a6efc admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.831416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.832114 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.832467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.832999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.833662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.835255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcfa38-5e19-408d-b8cb-ac5231765a9d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.851651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1043/2079] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:54.854972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:54.868546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e5986-a01a-4c7b-9d69-52d3fabcb3ec admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:54.874304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:54.874966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.875239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.875538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] PATH_INFO: `/v3/projects/2f10da4225a14e818c7f76e2b5874c8f/users/baae9a1b18eb4b938f66e7ffac3e0d00/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.905879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f10da4225a14e818c7f76e2b5874c8f, user_id=baae9a1b18eb4b938f66e7ffac3e0d00, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:54.908571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:54.939211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:54.939524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:54.939805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:54.942515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1037/2080] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:54:54 2022] PUT /identity/v3/projects/2f10da4225a14e818c7f76e2b5874c8f/users/baae9a1b18eb4b938f66e7ffac3e0d00/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:54.992406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] MFA Rules not processed for user `baae9a1b18eb4b938f66e7ffac3e0d00`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:54.994130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:55.015859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:55.112493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1044/2081] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:55.128643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:55.130513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:55.202763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a8770-3341-4ba8-9559-7da21e990942 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:55.207346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:55.208064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:55.208397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:55.208597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:55.216575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:55.220290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:55.222985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cecc71-0424-4afd-84ac-368c67e1b72b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:55.236617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1038/2082] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:57.288383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:57.292254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:57.386428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26c695-b846-4b9c-b347-8d6fdd440bba None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:57.393456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:57.394184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.394535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.395050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] PATH_INFO: `/v3/users/b8feb40088c8492da7fb39b91e52bd4a` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.396492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8feb40088c8492da7fb39b91e52bd4a)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:57.398649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.475425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8feb40088c8492da7fb39b91e52bd4a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.476291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8feb40088c8492da7fb39b91e52bd4a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.477041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8feb40088c8492da7fb39b91e52bd4a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.487451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8feb40088c8492da7fb39b91e52bd4a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.500002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8feb40088c8492da7fb39b91e52bd4a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:57.531182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1045/2083] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:57 2022] DELETE /identity/v3/users/b8feb40088c8492da7fb39b91e52bd4a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:57.533785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.534295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.535522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.559375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:57.560898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:57.635274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1039/2084] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:57.646472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:57.648143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:57.692507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:57.721370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218417e8-1e4b-44d0-88ec-26c63ec3b157 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:57.725662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:57.726276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:57.726570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:57.726832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:57.737338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:57.738922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:57.754249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1046/2085] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:54:58.255630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:58.257346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:58.281274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4d567-310e-47d4-aa64-e54ae8a8449c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:58.286245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:58.287426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:58.287960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:58.288459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] PATH_INFO: `/v3/projects/342c4a1aad4a4fcda55f9ae6a6790309` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:58.290065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=342c4a1aad4a4fcda55f9ae6a6790309)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:58.294180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:58.399073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '342c4a1aad4a4fcda55f9ae6a6790309', 'request_id': 'req-db80a821-66d9-4855-9e0e-934256b7e2fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.416206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '342c4a1aad4a4fcda55f9ae6a6790309', 'request_id': 'req-db80a821-66d9-4855-9e0e-934256b7e2fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.427968 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '342c4a1aad4a4fcda55f9ae6a6790309', 'request_id': 'req-db80a821-66d9-4855-9e0e-934256b7e2fa'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.453643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] The token cache is being invalidate because project 342c4a1aad4a4fcda55f9ae6a6790309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:58.453935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.454848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.462732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1040/2086] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:58 2022] DELETE /identity/v3/projects/342c4a1aad4a4fcda55f9ae6a6790309 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:58.466975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:58.477818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dcc8e-c9be-403c-9e81-4dfe49c26446 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:58.546139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:58.547068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:58.547534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:58.547971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] PATH_INFO: `/v3/users/b757ca9b48ee40dda5350d57150ff3a1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:58.551212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b757ca9b48ee40dda5350d57150ff3a1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:58.553640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:58.629620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b757ca9b48ee40dda5350d57150ff3a1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.630418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b757ca9b48ee40dda5350d57150ff3a1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.631150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b757ca9b48ee40dda5350d57150ff3a1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.640627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b757ca9b48ee40dda5350d57150ff3a1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.651112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ff55fe45-5595-46ea-bb2c-d392ce7e8a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b757ca9b48ee40dda5350d57150ff3a1'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:58.691960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1047/2087] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:58 2022] DELETE /identity/v3/users/b757ca9b48ee40dda5350d57150ff3a1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:59.042201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.045068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.070668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a821-66d9-4855-9e0e-934256b7e2fa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.154127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.155070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.155614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.156133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] PATH_INFO: `/v3/projects/57639b40b8de492bbf565b5a2a905d17` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.157663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57639b40b8de492bbf565b5a2a905d17)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.159925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.200940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:59.262463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57639b40b8de492bbf565b5a2a905d17', 'request_id': 'req-4b756538-0033-4c09-b19b-3768fa68a626'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.270556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57639b40b8de492bbf565b5a2a905d17', 'request_id': 'req-4b756538-0033-4c09-b19b-3768fa68a626'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.277949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57639b40b8de492bbf565b5a2a905d17', 'request_id': 'req-4b756538-0033-4c09-b19b-3768fa68a626'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.311204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] The token cache is being invalidate because project 57639b40b8de492bbf565b5a2a905d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:54:59.311527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.312810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.316546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1041/2088] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:54:59 2022] DELETE /identity/v3/projects/57639b40b8de492bbf565b5a2a905d17 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:59.321550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4d0a-26c4-486f-8d03-c8d83d9bc924 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.321841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4d0a-26c4-486f-8d03-c8d83d9bc924 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.322147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4d0a-26c4-486f-8d03-c8d83d9bc924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.367824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-584b4d0a-26c4-486f-8d03-c8d83d9bc924 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:59.369062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-584b4d0a-26c4-486f-8d03-c8d83d9bc924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.460683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.462622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.476310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:59.505155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1048/2089] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:59.514009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.514292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.514762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.539425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:59.541044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.552228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1049/2090] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:54:59.556569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.568045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f84d85-2c1d-4614-acae-4768f0231b86 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.582894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.583972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.584971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.586328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.587211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:54:59.588059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.592028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.606083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b756538-0033-4c09-b19b-3768fa68a626 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.611300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.611975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.612253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.612527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] PATH_INFO: `/v3/users/084f2df437124a1f98d069d21b25c666` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.614104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=084f2df437124a1f98d069d21b25c666)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.615603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.619124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1050/2091] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:54:59.623153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.634558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6643f-030e-4d0a-a1be-2c20d2609f4d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.640422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.641029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.641304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.641582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.642273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.644852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.679008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '084f2df437124a1f98d069d21b25c666'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.680050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '084f2df437124a1f98d069d21b25c666'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.691303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1051/2092] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:54:59 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:59.696420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.698556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '084f2df437124a1f98d069d21b25c666'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.700833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '084f2df437124a1f98d069d21b25c666'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.726373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5c46ae29-7bad-428b-8642-13a30858d2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '084f2df437124a1f98d069d21b25c666'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:54:59.758805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1042/2093] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:54:59 2022] DELETE /identity/v3/users/084f2df437124a1f98d069d21b25c666 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:54:59.765877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.766286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.766701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.775127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949e8d4-9972-43da-babb-a66b77be078c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.804205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:54:59.805602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.834230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:54:59.846369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.847059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.847552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.847896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.848768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.851437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.887111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1052/2094] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:54:59 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:54:59.888140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.890078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.901653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1043/2095] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:54:59.912129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84fe4-d8ed-4edf-9e56-ce9c5db3eb59 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.914433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.915988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:54:59.920101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.921628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.922130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.922583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.924112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.926652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:54:59.944963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1053/2096] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:54:59.946683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:54:59.960679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769410b8-b905-4fd4-82fa-0071fd02e86d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:54:59.968699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:54:59.978053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:54:59.978497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:54:59.978913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:54:59.979713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:54:59.984897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.001059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1054/2097] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:00.006091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.017869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570c05c2-fba5-4713-8154-ebdcb35df64f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.023713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.024368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.024648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.024919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] PATH_INFO: `/v3/projects/47aa504a20b341dbb497403a7c43f78c/users/5e263f92843e48a49704bdfc15b295d5/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.044194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aa504a20b341dbb497403a7c43f78c, user_id=5e263f92843e48a49704bdfc15b295d5, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.046362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd60186-556c-4142-acc4-d67b8de1a17f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.047105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98424f65-dd43-44d9-8ff3-63e88de24968 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.055007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.055726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.056695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.056986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.074156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1055/2098] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:00 2022] PUT /identity/v3/projects/47aa504a20b341dbb497403a7c43f78c/users/5e263f92843e48a49704bdfc15b295d5/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:00.074382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.074382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.076029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.076350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.076599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.083560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1044/2099] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:00.091158 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.130031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] MFA Rules not processed for user `5e263f92843e48a49704bdfc15b295d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:00.133528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:00.237451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1056/2100] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:00.242063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.259634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3172aa-94a0-4f13-b6d9-6d1adacfa4e5 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.400808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.403647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.403984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.404326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.405734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.408030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.454435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1045/2101] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:00 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:00.460613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.476318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19610854-66e0-4bb1-8326-7950a5698bbb None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.543741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.546947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:00.585691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.587174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.587848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.588259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.589147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.592906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.631957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1057/2102] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:00 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:00.640749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.654193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48dc00-158f-4fe6-9a08-d461920d4eac admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.660975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.662102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.662384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.662719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.662964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.663692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.665610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.674206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526741d-2228-41d3-b9bb-5dc3da9282bf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.685337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.685786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1058/2103] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:00.685876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.685876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.685876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] PATH_INFO: `/v3/projects/8e73b319a97a4cf0a95e7b1f9cd3e673` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.686811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.687333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e73b319a97a4cf0a95e7b1f9cd3e673)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.689714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.698930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b148d1e0-bd3c-4315-bea2-36ec96e7e852 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.707704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.709396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.709396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.711072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] PATH_INFO: `/v3/projects/5a091c5ba5404dd5ad8cec3695e36813/users/d576670f008f452b8e0ef093da0cca94/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.747995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a091c5ba5404dd5ad8cec3695e36813, user_id=d576670f008f452b8e0ef093da0cca94, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.753118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.766228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e73b319a97a4cf0a95e7b1f9cd3e673', 'request_id': 'req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.768067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1059/2104] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:00 2022] PUT /identity/v3/projects/5a091c5ba5404dd5ad8cec3695e36813/users/d576670f008f452b8e0ef093da0cca94/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:00.772697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.774195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e73b319a97a4cf0a95e7b1f9cd3e673', 'request_id': 'req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.783795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e73b319a97a4cf0a95e7b1f9cd3e673', 'request_id': 'req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.804343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] The token cache is being invalidate because project 8e73b319a97a4cf0a95e7b1f9cd3e673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:00.804828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.806061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.810036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1046/2105] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:00 2022] DELETE /identity/v3/projects/8e73b319a97a4cf0a95e7b1f9cd3e673 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:00.814309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.817822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:00.833552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:00.851586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3b572-fc33-405a-9b8a-85f3ec9ca217 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.857786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.858497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.858879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.859221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.859966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.861948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.875939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1060/2106] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:00.879894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:00.881913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:00.897681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c4f9e-fd1a-4e56-bd91-84d53d2cbdcf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.898876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31718b2b-3f37-4259-a8a7-a2d0d4d77d3b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:00.904506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.905210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.905531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:00.905640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.905895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] PATH_INFO: `/v3/users/fa5f7e9fc6fd499ea375437961972ec7` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.906201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.906483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.906756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] PATH_INFO: `/v3/projects/5a091c5ba5404dd5ad8cec3695e36813/users/d576670f008f452b8e0ef093da0cca94/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.908103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5f7e9fc6fd499ea375437961972ec7)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.909059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a091c5ba5404dd5ad8cec3695e36813, user_id=d576670f008f452b8e0ef093da0cca94, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:00.910438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.911977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb8a96-568d-4211-baca-35d7ddce1b1e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:00.924962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1061/2107] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:00 2022] PUT /identity/v3/projects/5a091c5ba5404dd5ad8cec3695e36813/users/d576670f008f452b8e0ef093da0cca94/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:00.936496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:00.936792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:00.937068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:00.970714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] MFA Rules not processed for user `d576670f008f452b8e0ef093da0cca94`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:00.971970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:00.980684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5f7e9fc6fd499ea375437961972ec7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.981475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5f7e9fc6fd499ea375437961972ec7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.990750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5f7e9fc6fd499ea375437961972ec7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:00.991715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5f7e9fc6fd499ea375437961972ec7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.001013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5f7e9fc6fd499ea375437961972ec7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.034501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1047/2108] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:00 2022] DELETE /identity/v3/users/fa5f7e9fc6fd499ea375437961972ec7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:01.078933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1062/2109] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:00 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:01.096416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:01.099746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:01.113782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:01.180379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d46f61-6dd0-4a59-9629-569c9e3dc702 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:01.186727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:01.187370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:01.187766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:01.188162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:01.290018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:01.291584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:01.305880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1048/2110] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:01 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:01.567272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:01.568863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:01.700500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997c08-da31-4bc9-b344-a640ff431a82 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:01.798322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:01.799088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:01.799503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:01.799859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] PATH_INFO: `/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:01.801123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31ff6e3b5b0e42da9e79f8f20b03e3ac)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:01.804116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:01.817483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:01.864940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31ff6e3b5b0e42da9e79f8f20b03e3ac', 'request_id': 'req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.874505 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31ff6e3b5b0e42da9e79f8f20b03e3ac', 'request_id': 'req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.882090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31ff6e3b5b0e42da9e79f8f20b03e3ac', 'request_id': 'req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.894490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:01.895178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] The token cache is being invalidate because project 31ff6e3b5b0e42da9e79f8f20b03e3ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:01.895447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.895964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:01.896089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6d4dad67-f6cc-4ec4-a0a8-844f81da598f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:01.897789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1063/2111] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:01 2022] DELETE /identity/v3/projects/31ff6e3b5b0e42da9e79f8f20b03e3ac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:01.903964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc1e-8e36-4b2d-980c-48d66423a42a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:01.904241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc1e-8e36-4b2d-980c-48d66423a42a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:01.904511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800dc1e-8e36-4b2d-980c-48d66423a42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:01.913113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d278a-59b3-4e1b-91cf-03f79fc77d73 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:01.925440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8800dc1e-8e36-4b2d-980c-48d66423a42a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:01.926774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8800dc1e-8e36-4b2d-980c-48d66423a42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:01.976118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:01.976781 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:01.977062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:01.977334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] PATH_INFO: `/v3/users/5e263f92843e48a49704bdfc15b295d5` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:01.978460 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e263f92843e48a49704bdfc15b295d5)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:01.980456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:01.992097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1064/2112] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:02.001067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.001357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.001635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.023353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.024683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.031880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e263f92843e48a49704bdfc15b295d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.032548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e263f92843e48a49704bdfc15b295d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.033249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1065/2113] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:02.037883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.040895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e263f92843e48a49704bdfc15b295d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.042105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e263f92843e48a49704bdfc15b295d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.047772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.048728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e6a1ef-d5d9-4195-8092-f121e2e77f9c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.053432 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e263f92843e48a49704bdfc15b295d5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.055247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.056109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.056483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.056898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.057931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:02.058827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.061026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088e44b-2b99-4fd9-8e8f-0816e6326355 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.077560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1066/2114] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:55:02.077764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1049/2115] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:01 2022] DELETE /identity/v3/users/5e263f92843e48a49704bdfc15b295d5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:02.078634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.078781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.079100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.079426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.080155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.098960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.099369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.156023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6651-ee96-4990-adc8-891bcb7c9008 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.162907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.163607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.164250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.164821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.165961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.171493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1067/2116] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:02.172651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.178445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.179918 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.201931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.202508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1050/2117] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:02.207213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.247578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d849e5-b5a4-4600-a7cc-c672cf77bf56 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.276430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c531de2-f688-47ba-9013-504e28753b65 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.281425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.282036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.282350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.282609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.283421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.285358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.312662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1051/2118] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:02.313360 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.313928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.314065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.314250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.314582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.324862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195b202-aa2f-4f80-bbf1-2a80369f235b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.325678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.327119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.329732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.330390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.330726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.331099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.332234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.333652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.339957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1068/2119] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:02.344999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1052/2120] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:02.349281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.360721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd135-50fc-4e7a-a211-35ef9fa3bbee service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.365688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.366369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.366722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.367067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.367809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.369478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8286ff85-547f-4087-8ac6-7924a679b49b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.380583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1069/2121] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:02.384837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.397002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a920d25-877f-4a12-aac9-fbcb74fbb2c4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.402654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.403306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.403619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.403888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] PATH_INFO: `/v3/projects/9de712326922464cb91093b87d5ab8b7/users/49306f7b957849ed80c17a73ace6595b/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.422334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9de712326922464cb91093b87d5ab8b7, user_id=49306f7b957849ed80c17a73ace6595b, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.425164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.443504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1053/2122] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:02 2022] PUT /identity/v3/projects/9de712326922464cb91093b87d5ab8b7/users/49306f7b957849ed80c17a73ace6595b/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:02.453980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.454205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.454439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.495997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] MFA Rules not processed for user `49306f7b957849ed80c17a73ace6595b`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.497683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.603520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1070/2123] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:02.612967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.614767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.635455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.677388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217dc11f-b0da-49a2-b405-a3166493b4d3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.682234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.683732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.683936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.684213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.694350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.695818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.705294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1054/2124] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:02.728781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.738962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.740470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.803253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:02.817912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3b188-0fd5-411f-9f10-1e9922a14b26 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.821859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683de0f9-2ea4-43c1-aeda-220e231d3336 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:02.822890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.823554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.823888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.824166 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] PATH_INFO: `/v3/users/49306f7b957849ed80c17a73ace6595b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.825409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] RBAC: Authorizing `identity:delete_user(user_id=49306f7b957849ed80c17a73ace6595b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.826955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:02.827339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.827682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.827964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.828304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] PATH_INFO: `/v3/projects/47aa504a20b341dbb497403a7c43f78c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.829974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aa504a20b341dbb497403a7c43f78c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:02.831596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:02.883930 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49306f7b957849ed80c17a73ace6595b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.885061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49306f7b957849ed80c17a73ace6595b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.885697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49306f7b957849ed80c17a73ace6595b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.895082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49306f7b957849ed80c17a73ace6595b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.895801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aa504a20b341dbb497403a7c43f78c', 'request_id': 'req-fca08be8-d76f-4304-b5a4-9fc8888ee5de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.906143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aa504a20b341dbb497403a7c43f78c', 'request_id': 'req-fca08be8-d76f-4304-b5a4-9fc8888ee5de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.906882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-78ec95c7-a2d8-4d81-953c-3e0342db8aee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49306f7b957849ed80c17a73ace6595b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.913938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aa504a20b341dbb497403a7c43f78c', 'request_id': 'req-fca08be8-d76f-4304-b5a4-9fc8888ee5de'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.930608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1071/2125] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:02 2022] DELETE /identity/v3/users/49306f7b957849ed80c17a73ace6595b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:02.932883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] The token cache is being invalidate because project 47aa504a20b341dbb497403a7c43f78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:02.933219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.935077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:02.935526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:02.935807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:02.936096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:02.938116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1055/2126] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:02 2022] DELETE /identity/v3/projects/47aa504a20b341dbb497403a7c43f78c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:02.941604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:02.943100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:02.959811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:02.961267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.003934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.032009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca08be8-d76f-4304-b5a4-9fc8888ee5de admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.042319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1072/2127] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:03.052469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.053877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.101685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.102326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.102912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.102912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] PATH_INFO: `/v3/users/d576670f008f452b8e0ef093da0cca94` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.104243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d576670f008f452b8e0ef093da0cca94)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.106287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.124992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa3af3d-ff9b-4af2-86a3-edf2ab3002a6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.129415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.130107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.130449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.130899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.142897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.144371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.156153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1073/2128] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:03.164631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd576670f008f452b8e0ef093da0cca94'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.165697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd576670f008f452b8e0ef093da0cca94'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.176869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd576670f008f452b8e0ef093da0cca94'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.177991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd576670f008f452b8e0ef093da0cca94'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.187930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-036d3508-ef43-458c-804a-ea76d94269f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd576670f008f452b8e0ef093da0cca94'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.218252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1056/2129] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:02 2022] DELETE /identity/v3/users/d576670f008f452b8e0ef093da0cca94 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:03.453553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.455082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.485462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e648e-d70a-47a0-b316-ea72a3e7b417 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.503095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.555875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.556475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.556759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.557035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] PATH_INFO: `/v3/projects/9de712326922464cb91093b87d5ab8b7` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.558765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9de712326922464cb91093b87d5ab8b7)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.560830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.639145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9de712326922464cb91093b87d5ab8b7', 'request_id': 'req-b61c1978-ad61-49e7-8815-97bbee7c20ac'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.647537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9de712326922464cb91093b87d5ab8b7', 'request_id': 'req-b61c1978-ad61-49e7-8815-97bbee7c20ac'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.662622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9de712326922464cb91093b87d5ab8b7', 'request_id': 'req-b61c1978-ad61-49e7-8815-97bbee7c20ac'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.682000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] The token cache is being invalidate because project 9de712326922464cb91093b87d5ab8b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:03.682302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.683044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b61c1978-ad61-49e7-8815-97bbee7c20ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.686664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1074/2130] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:03 2022] DELETE /identity/v3/projects/9de712326922464cb91093b87d5ab8b7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:03.693599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.693898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.694303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.721262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:03.722642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.821405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1057/2131] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:03.829420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.829812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.830185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.856522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:03.857830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.860993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.863613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.867780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1075/2132] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:03.872551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.884169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496146fe-42b2-4375-a2aa-118973c6fe4e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.884682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d24dbaf-4126-419c-95d6-f246f2b34fcb None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.890384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.891172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.891838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.892117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.892232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.892396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.892508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.892670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] PATH_INFO: `/v3/projects/5a091c5ba5404dd5ad8cec3695e36813` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.893043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:03.893487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.893989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a091c5ba5404dd5ad8cec3695e36813)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.895081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.895908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.907864 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:03.909254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1076/2133] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:03.914254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.930796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237c9b1-8a6d-4ee7-97cf-4cbc25812c70 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:03.942288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:03.943191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:03.943491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:03.943771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:03.945917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:03.948578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:03.959280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a091c5ba5404dd5ad8cec3695e36813', 'request_id': 'req-174a3f0e-183c-434c-b6df-9798921c4afb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.970354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a091c5ba5404dd5ad8cec3695e36813', 'request_id': 'req-174a3f0e-183c-434c-b6df-9798921c4afb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.979716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a091c5ba5404dd5ad8cec3695e36813', 'request_id': 'req-174a3f0e-183c-434c-b6df-9798921c4afb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.984845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1077/2134] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:03 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:03.985931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.987718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:03.994848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] The token cache is being invalidate because project 5a091c5ba5404dd5ad8cec3695e36813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:03.995143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.995925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:03.997428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1058/2135] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:03 2022] DELETE /identity/v3/projects/5a091c5ba5404dd5ad8cec3695e36813 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:03.998525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:03.999673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.064650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e64de-3f3c-48d9-b5c0-be91b3c71fe4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.070796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.071654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.071935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.072205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] PATH_INFO: `/v3/users/23f26a8be62246d38f63884e08f382d0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.073343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f26a8be62246d38f63884e08f382d0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.076731 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.081137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a3f0e-183c-434c-b6df-9798921c4afb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.082770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.086828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.087541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.087890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.088229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.088949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.091846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d03e5-5296-4a02-98b4-11c437dac7ce admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.116718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1059/2136] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:03 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:04.118301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.118837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.119337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.138924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f26a8be62246d38f63884e08f382d0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:04.139878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f26a8be62246d38f63884e08f382d0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:04.140581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f26a8be62246d38f63884e08f382d0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:04.143410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:04.144856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.148949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f26a8be62246d38f63884e08f382d0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:04.155205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1060/2137] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:04.156115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.157464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.166128 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-03b8a754-9b9d-40c0-b629-3a8f57190f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f26a8be62246d38f63884e08f382d0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:04.171127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7384e028-993d-48c3-9bf3-92f9c1257eb5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.177427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.180211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.180523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.180890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.181805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.184530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfb9f0c-41c8-4c33-83eb-f7889e7b882a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.190887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1078/2138] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:03 2022] DELETE /identity/v3/users/23f26a8be62246d38f63884e08f382d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:04.192336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.192626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.192899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.199977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1061/2139] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:04.201417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.201887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.202223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.221777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:04.223040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.225145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:04.226710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.291619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1062/2140] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:04.292855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.305468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121baa7-7659-41ac-b870-84301d7aa2d3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.318034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.318664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.318941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.320718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1079/2141] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:04.322080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.322848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.323648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.325282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.326403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.331911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.352495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1063/2142] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:04.357536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.372744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f984da4-61dc-444a-9a5b-a96b37c2d48e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.382833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.383458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.384145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.384426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.385102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:04.385711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.389082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.401436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fbadf-3846-458d-82ce-6bc7bbd2cc4c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.404516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1064/2143] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:04.408896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.409394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.410337 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.410613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.411716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.422743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3344e-dca6-4cda-b519-7931bc61cb75 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.427443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.427638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.428218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.428636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.428918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] PATH_INFO: `/v3/projects/94900a32f8034efca826eda4a232aa62/users/d9b02cb26d9645c9b8ef5871b0b9e194/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.430167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.445521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1080/2144] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:04.447291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.465009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f32d32-5742-4e5c-a034-b76f5aeb0216 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.465478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=94900a32f8034efca826eda4a232aa62, user_id=d9b02cb26d9645c9b8ef5871b0b9e194, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.468238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c057a-f41d-407e-b757-321a65bfdd5c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.470867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.472036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.472472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.472886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.473658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.475784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.505313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1065/2145] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:04 2022] PUT /identity/v3/projects/94900a32f8034efca826eda4a232aa62/users/d9b02cb26d9645c9b8ef5871b0b9e194/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:04.516904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.517262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.517682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.521939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1081/2146] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:04.526036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.548139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.561406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] MFA Rules not processed for user `d9b02cb26d9645c9b8ef5871b0b9e194`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:04.563140 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.645860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60db9a1-672a-4b92-913a-37c0c558a747 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.657074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.658873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.659381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.659900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.661111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.661832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1066/2147] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:04.664214 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.670691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.672348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.719361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1082/2148] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:04.720575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.736702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e6dee-0213-4e5d-95af-80f5b3ca92b4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.742394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.743321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.743594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.744115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.744997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.747728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.786593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1083/2149] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:04.790833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.805551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0ee855-e753-407f-9023-4067566a69f6 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.816972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190c16-8d35-4164-9c7d-17709cccb796 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.817816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.818339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.818618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.818893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.831707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.832375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.832761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.833032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.833880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.834656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.837453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.837602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.860245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1067/2150] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:04.861324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.862837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:04.869679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1084/2151] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:04.875096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:04.886975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e8a72-f646-47a1-80a1-00fc11ffa86e service glance] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.893404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.894020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ed3ac-0e9b-47bc-bf23-05e7c2e99025 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:04.894119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.894314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.894714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] PATH_INFO: `/v3/projects/74e738c71afb43958f6b8758a06bf8f1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.902659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=74e738c71afb43958f6b8758a06bf8f1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.908989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:04.909661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.909979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.910327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] PATH_INFO: `/v3/projects/cd58618ca2bf4f0a8e541a9e2ed1674c/users/f724a04133e3494a9a0f14618cce9d0c/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:04.916065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.937752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd58618ca2bf4f0a8e541a9e2ed1674c, user_id=f724a04133e3494a9a0f14618cce9d0c, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:04.942686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea246fbe-04a8-41d4-83b0-a0ab2cb475d3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:04.979609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1085/2152] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:04 2022] PUT /identity/v3/projects/cd58618ca2bf4f0a8e541a9e2ed1674c/users/f724a04133e3494a9a0f14618cce9d0c/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:04.985291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:04.991202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:04.991560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:04.991874 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.010364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74e738c71afb43958f6b8758a06bf8f1', 'request_id': 'req-b57c1981-6457-4a6c-9f59-85091ceec4fc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:05.023528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74e738c71afb43958f6b8758a06bf8f1', 'request_id': 'req-b57c1981-6457-4a6c-9f59-85091ceec4fc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:05.025452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] MFA Rules not processed for user `f724a04133e3494a9a0f14618cce9d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:05.027798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.030741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74e738c71afb43958f6b8758a06bf8f1', 'request_id': 'req-b57c1981-6457-4a6c-9f59-85091ceec4fc'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:05.051002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] The token cache is being invalidate because project 74e738c71afb43958f6b8758a06bf8f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:05.051297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:05.052007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b57c1981-6457-4a6c-9f59-85091ceec4fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:05.055516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1068/2153] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:04 2022] DELETE /identity/v3/projects/74e738c71afb43958f6b8758a06bf8f1 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:05.059300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a9a4-e8bc-421e-b92b-8f94ea98f252 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.059425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a9a4-e8bc-421e-b92b-8f94ea98f252 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.059810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188a9a4-e8bc-421e-b92b-8f94ea98f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.103165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3188a9a4-e8bc-421e-b92b-8f94ea98f252 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:05.104557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3188a9a4-e8bc-421e-b92b-8f94ea98f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.210417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1086/2154] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:05.223558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.225388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.253116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1069/2155] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:05.261070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.262340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.263293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.302333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:05.316580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:05.317967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.325103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d52be6-6b47-4262-bb0d-ee363111f7ff None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.329431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.330289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.331113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.331579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.341438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1070/2156] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:05.346088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.348020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.349847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.362188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3facf4f2-5047-4dcc-a0c1-e76e22e72245 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.365200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1087/2157] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:05.372681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.373753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.374186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.374604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.375498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:05.375970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.378095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.395704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1071/2158] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:55:05.399764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.413570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72d86d-fa5c-47d5-8f10-748113aabf9b service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.420608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.421317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.421985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.422107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.423237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.425782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.468935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.478897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1088/2159] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:05 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:05.486196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6a5f8-12bb-4a7b-b3a6-08d3646186fb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.602888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.603683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.604607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.604607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.606567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.608547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.653628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1072/2160] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:05 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:05.657887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.676086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a850-b577-4d81-88d2-236ab5a2e1a0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.685255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.686253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.686785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.687286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.688269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.691960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.705454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1089/2161] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:05.709505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.726855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b787ade-cd2f-41c9-a1d3-c3732354745a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.732430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.734049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.734365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.734644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.735457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.737520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d7635-4efb-4343-99ac-6a4419d6596c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.753617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1073/2162] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:05.758077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:05.778474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69d4d7-8433-44b9-9261-1267e5236c99 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:05.788441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:05.789345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.789806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.790369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] PATH_INFO: `/v3/projects/6497096b55a1411abaff8c2f80d3eb08/users/bf41bacfc4214e26bfbbeafe7186bf37/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.810171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6497096b55a1411abaff8c2f80d3eb08, user_id=bf41bacfc4214e26bfbbeafe7186bf37, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:05.813184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:05.833865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1090/2163] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:05 2022] PUT /identity/v3/projects/6497096b55a1411abaff8c2f80d3eb08/users/bf41bacfc4214e26bfbbeafe7186bf37/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:05.840465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:05.840791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:05.841233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:05.886398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:05.887853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:05.916566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:05.997561 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1074/2164] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:06.004202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:06.006286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:06.024668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:06.025675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:06.042290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef92bf8-81b1-4e5a-9282-72a564e844d5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:06.047856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:06.048655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:06.049591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:06.049872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] PATH_INFO: `/v3/users/baae9a1b18eb4b938f66e7ffac3e0d00` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:06.051223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baae9a1b18eb4b938f66e7ffac3e0d00)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:06.053833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:06.094207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d66a58-0aba-47cd-bafb-d0be29124358 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:06.098359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:06.099718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:06.099999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:06.100274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:06.111738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:06.113290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d8565-cccc-49ef-9c1b-b1011cbe23fd service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:06.114170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baae9a1b18eb4b938f66e7ffac3e0d00'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:06.114910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baae9a1b18eb4b938f66e7ffac3e0d00'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:06.125750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baae9a1b18eb4b938f66e7ffac3e0d00'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:06.126857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baae9a1b18eb4b938f66e7ffac3e0d00'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:06.127167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1091/2165] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:06.135601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baae9a1b18eb4b938f66e7ffac3e0d00'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:06.161323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1075/2166] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:06 2022] DELETE /identity/v3/users/baae9a1b18eb4b938f66e7ffac3e0d00 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:06.165518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:06.165807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:06.166087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:06.190723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:06.192193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:06.275640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1092/2167] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:06.289740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:06.291335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:06.428006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6692-4038-4da7-b5f4-b3df2a3ba8d0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:06.433520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:06.434139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:06.434439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:06.434789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:06.455534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:06.455534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:06.468726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1076/2168] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:07.597755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:07.599390 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:07.621455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72769c09-bb42-451b-9c1d-457c97528aa8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:07.632780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:07.633435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:07.633718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:07.633995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] PATH_INFO: `/v3/projects/2f10da4225a14e818c7f76e2b5874c8f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:07.635916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f10da4225a14e818c7f76e2b5874c8f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:07.644103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:07.717079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:07.767056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f10da4225a14e818c7f76e2b5874c8f', 'request_id': 'req-463c4dc8-6380-4895-8d50-d4bf9e8b1993'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:07.777810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f10da4225a14e818c7f76e2b5874c8f', 'request_id': 'req-463c4dc8-6380-4895-8d50-d4bf9e8b1993'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:07.793972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f10da4225a14e818c7f76e2b5874c8f', 'request_id': 'req-463c4dc8-6380-4895-8d50-d4bf9e8b1993'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:07.830743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] The token cache is being invalidate because project 2f10da4225a14e818c7f76e2b5874c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:07.831500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:07.832574 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:07.836868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1093/2169] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:07 2022] DELETE /identity/v3/projects/2f10da4225a14e818c7f76e2b5874c8f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:08.119762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:08.121958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:08.143313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51e862-954e-40d3-a999-ebef6c20f616 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:08.186633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:08.255194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:08.256104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.256600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.257061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] PATH_INFO: `/v3/users/9d247454fd674803ba080bb60ac2f645` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.258617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d247454fd674803ba080bb60ac2f645)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:08.260810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:08.329724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d247454fd674803ba080bb60ac2f645'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.331221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d247454fd674803ba080bb60ac2f645'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.340525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d247454fd674803ba080bb60ac2f645'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.341334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d247454fd674803ba080bb60ac2f645'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.350993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-5ebce98f-4dff-4368-b49f-77da5510e1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d247454fd674803ba080bb60ac2f645'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.379006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1077/2170] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:08 2022] DELETE /identity/v3/users/9d247454fd674803ba080bb60ac2f645 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:08.648977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:08.649911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:08.694015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c4dc8-6380-4895-8d50-d4bf9e8b1993 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:08.801037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:08.801729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.802019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.802295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] PATH_INFO: `/v3/projects/e24baea8cbb74113b5c5b891a4245b5c` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.803547 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e24baea8cbb74113b5c5b891a4245b5c)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:08.805543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:08.869243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e24baea8cbb74113b5c5b891a4245b5c', 'request_id': 'req-b1925ba4-9820-4100-8e93-a50992d2381b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.880003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e24baea8cbb74113b5c5b891a4245b5c', 'request_id': 'req-b1925ba4-9820-4100-8e93-a50992d2381b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.915627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e24baea8cbb74113b5c5b891a4245b5c', 'request_id': 'req-b1925ba4-9820-4100-8e93-a50992d2381b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.930636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] The token cache is being invalidate because project e24baea8cbb74113b5c5b891a4245b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:08.931396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.932276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b1925ba4-9820-4100-8e93-a50992d2381b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:08.934370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1094/2171] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:08 2022] DELETE /identity/v3/projects/e24baea8cbb74113b5c5b891a4245b5c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:08.938952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:08.939364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:08.939679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:08.969534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:08.971386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.057314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1078/2172] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.065814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.066105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.066380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.086226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:09.087497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.095783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1095/2173] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.100181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.110873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4808-2aba-4fc8-af90-d9f5d3d42689 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.115844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.116494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.116806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.117061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.117758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:09.118133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.119751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.133869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1079/2174] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:09.138500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.148571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b00cd-f16d-4e2a-b2b2-bca333fb346d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.153692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.154303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.154579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.154845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.155503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.157472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.198565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1096/2175] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/projects => generated 405 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:09.201221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.213312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a357c15-0d5d-47ec-82ac-27e430a7be1a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.276435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:09.310368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.311083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.311435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.311812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.312512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.314499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.337819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1080/2176] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/users => generated 303 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:09.341856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.353023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd70c014-0cdc-47dd-8875-ab7eba0f725b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.358340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.358948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.359222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.359518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.360237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.361831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.367876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:09.374201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1097/2177] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:09.378453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.389919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd995-7e4a-4b6b-9eaa-b12b7fb15b4d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.396317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.396940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.397248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.397521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.398167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.399831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2151ef1-a802-47cb-ba4e-d84fc8c84793 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.412840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1081/2178] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:09.417319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.428873 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e0b63-7371-4809-bd12-595110403575 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.434591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.435269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.435583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.435863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] PATH_INFO: `/v3/projects/2f1db2f229f5424893abfdfbdb3cc2b2/users/c60ac0c8b69749a98a5ae380b51835c3/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.457513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1db2f229f5424893abfdfbdb3cc2b2, user_id=c60ac0c8b69749a98a5ae380b51835c3, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.460421 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.480476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1098/2179] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:09 2022] PUT /identity/v3/projects/2f1db2f229f5424893abfdfbdb3cc2b2/users/c60ac0c8b69749a98a5ae380b51835c3/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:09.491241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230deab9-9298-47d2-9ec0-32da58410def None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.491391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230deab9-9298-47d2-9ec0-32da58410def None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.491657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230deab9-9298-47d2-9ec0-32da58410def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.535201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-230deab9-9298-47d2-9ec0-32da58410def None None] MFA Rules not processed for user `c60ac0c8b69749a98a5ae380b51835c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:09.536605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-230deab9-9298-47d2-9ec0-32da58410def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:09.630501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1082/2180] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:09.634939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.709301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2f55c2-ff33-44fe-a1f3-449ae0a72f2a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.715174 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.715570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.715925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.716269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.717033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.719322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.766729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1099/2181] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:09.768975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230deab9-9298-47d2-9ec0-32da58410def None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.781258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230deab9-9298-47d2-9ec0-32da58410def None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.895027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.896036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.896373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.896648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.897338 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.899396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.928284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1083/2182] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:09 2022] POST /identity/v3/users => generated 309 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:09.932175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.944516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b511b9-fb78-43dd-9dd2-c47085ae5416 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.951558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.952626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.952626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.952838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:09.953776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:09.955608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:09.973054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1100/2183] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:09.974180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:09.985902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7337f30-d6f3-4fb9-91bb-954334962ea2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:09.993465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:09.994145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:09.994425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:09.994721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] PATH_INFO: `/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f/users/ec918091f9b2467198447e61153fe9fc/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.014916 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4783c119ccc54e34bbdcc28d40f5fd8f, user_id=ec918091f9b2467198447e61153fe9fc, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.017953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.041301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1084/2184] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:09 2022] PUT /identity/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f/users/ec918091f9b2467198447e61153fe9fc/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:10.055043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.066570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b12b-9458-4590-90b4-1a3e3664afc7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.136255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.137063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.137342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.137614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.138349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.139982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d95b04-3c2d-4457-9b1c-9436bd01e4b8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.158455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1101/2185] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:10.158660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.176689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c80d-428a-4146-b833-8581d3402c54 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.182749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.183750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.184189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.185175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] PATH_INFO: `/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f/users/ec918091f9b2467198447e61153fe9fc/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.187848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4783c119ccc54e34bbdcc28d40f5fd8f, user_id=ec918091f9b2467198447e61153fe9fc, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.190636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.198906 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:10.205062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1085/2186] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:10 2022] PUT /identity/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f/users/ec918091f9b2467198447e61153fe9fc/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:10.215926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.216209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.216483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.247273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] MFA Rules not processed for user `ec918091f9b2467198447e61153fe9fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:10.248457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.291277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:10.339847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1102/2187] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:10.354179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.358856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:10.443018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a45426-7125-4d20-8dd0-562d1c235d79 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.455078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.455777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.457138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.457429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.478905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.482109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41e60f-527a-45c4-a594-7b665228a401 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.505339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1086/2188] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:10 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:10.736695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:10.818764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d309474-536f-47e2-887d-74f1019adb3b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:10.827420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:10.829262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.829713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.830149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] PATH_INFO: `/v3/users/c60ac0c8b69749a98a5ae380b51835c3` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:10.832197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60ac0c8b69749a98a5ae380b51835c3)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:10.835221 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:10.908467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60ac0c8b69749a98a5ae380b51835c3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:10.909147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60ac0c8b69749a98a5ae380b51835c3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:10.909756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60ac0c8b69749a98a5ae380b51835c3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:10.920150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60ac0c8b69749a98a5ae380b51835c3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:10.933694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60ac0c8b69749a98a5ae380b51835c3'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:10.989380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1103/2189] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:10 2022] DELETE /identity/v3/users/c60ac0c8b69749a98a5ae380b51835c3 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:10.993746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:10.994035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:10.994313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.015361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:11.016643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.110231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1087/2190] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:11.122215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:11.124357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.210082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b85e6-6b1f-42c4-b0eb-fe42bc467122 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:11.217515 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:11.218504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.218789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.219676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.232889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:11.240732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:11.242844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:11.265482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1104/2191] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:11.802445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:11.804187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:11.817844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9dc8-95c3-4ce3-854f-4d33c1eeedbc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:11.824986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:11.825631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:11.825909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:11.826183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] PATH_INFO: `/v3/projects/2f1db2f229f5424893abfdfbdb3cc2b2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:11.827310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1db2f229f5424893abfdfbdb3cc2b2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:11.829241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:11.892773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1db2f229f5424893abfdfbdb3cc2b2', 'request_id': 'req-7bf0f497-4378-49e0-ab98-4aedec5df725'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:11.902537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1db2f229f5424893abfdfbdb3cc2b2', 'request_id': 'req-7bf0f497-4378-49e0-ab98-4aedec5df725'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:11.910595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1db2f229f5424893abfdfbdb3cc2b2', 'request_id': 'req-7bf0f497-4378-49e0-ab98-4aedec5df725'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:11.927323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] The token cache is being invalidate because project 2f1db2f229f5424893abfdfbdb3cc2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:11.927808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:11.929662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf0f497-4378-49e0-ab98-4aedec5df725 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:11.931667 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1088/2192] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:11 2022] DELETE /identity/v3/projects/2f1db2f229f5424893abfdfbdb3cc2b2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:11.935783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:11.951424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4da847-95ce-4ace-ad4b-21c8165c743c service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.076847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.077523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.077801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.078081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] PATH_INFO: `/v3/users/ec918091f9b2467198447e61153fe9fc` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.079296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec918091f9b2467198447e61153fe9fc)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.082472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.145008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec918091f9b2467198447e61153fe9fc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.146199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec918091f9b2467198447e61153fe9fc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.146753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec918091f9b2467198447e61153fe9fc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.158156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec918091f9b2467198447e61153fe9fc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.178923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec918091f9b2467198447e61153fe9fc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.207605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1105/2193] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:11 2022] DELETE /identity/v3/users/ec918091f9b2467198447e61153fe9fc => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:12.246554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.247121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.247849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.279311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] MFA Rules not processed for user `bf41bacfc4214e26bfbbeafe7186bf37`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:12.281927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.300266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:12.387835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1089/2194] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:12.392751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.397693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.499855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0f6d6b-9b86-40a4-93df-66df4e46a7b6 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.505481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.506767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.506767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.506767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.507412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.509388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.539714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:12.551907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1106/2195] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:12.552803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.568748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73413cb-70a2-4b7b-859d-3873865adae9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.595452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.597415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.664568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.665572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.665856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.666127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.666804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.670590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.699558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651b5a0-2213-4b00-a93f-736d65cfdb45 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.708257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.708980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.709248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.709516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] PATH_INFO: `/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.710921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4783c119ccc54e34bbdcc28d40f5fd8f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.713088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.734547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1090/2196] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/users => generated 299 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:12.740563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.753096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb05607-c6f6-48a9-aace-46f24e7703bf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.758571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.759283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.759603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.759873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.760604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.763167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.784392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1091/2197] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:12.785886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.788697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4783c119ccc54e34bbdcc28d40f5fd8f', 'request_id': 'req-895a22b4-380a-45c3-b4ec-3f7707433278'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.798018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4783c119ccc54e34bbdcc28d40f5fd8f', 'request_id': 'req-895a22b4-380a-45c3-b4ec-3f7707433278'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.798355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc8fde-40fa-46bb-928b-2ab155efff43 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:12.808935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4783c119ccc54e34bbdcc28d40f5fd8f', 'request_id': 'req-895a22b4-380a-45c3-b4ec-3f7707433278'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.827250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] The token cache is being invalidate because project 4783c119ccc54e34bbdcc28d40f5fd8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:12.827597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.828458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-895a22b4-380a-45c3-b4ec-3f7707433278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:12.833494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1107/2198] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:12 2022] DELETE /identity/v3/projects/4783c119ccc54e34bbdcc28d40f5fd8f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:12.835109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e5ca-4b18-4c7a-b8d4-ccb4cabe2cdd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.835403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e5ca-4b18-4c7a-b8d4-ccb4cabe2cdd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.835781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04e5ca-4b18-4c7a-b8d4-ccb4cabe2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.861400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-da04e5ca-4b18-4c7a-b8d4-ccb4cabe2cdd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:12.863054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-da04e5ca-4b18-4c7a-b8d4-ccb4cabe2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.867456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:12.868277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.868751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.869132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] PATH_INFO: `/v3/projects/a3ae98bde67447d09a9cda491b46ecdc/users/4e9a8d0bfe404695aac2758db670f248/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.875938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1108/2199] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:12.885234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:12.888314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:12.888708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:12.899771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae98bde67447d09a9cda491b46ecdc, user_id=4e9a8d0bfe404695aac2758db670f248, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:12.904404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:12.924414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1092/2200] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:12 2022] PUT /identity/v3/projects/a3ae98bde67447d09a9cda491b46ecdc/users/4e9a8d0bfe404695aac2758db670f248/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:12.928521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:12.930230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:12.935381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.935936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:12.983978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:13.037957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1109/2201] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:13.042177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.042759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b094f21-1bc9-43f6-bb67-00ec8b8be9cb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.048413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.049313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.049521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.049893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.050641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.052378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.052920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737138f1-6e64-4503-b53a-4034b0148a8b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.058483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.059156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.059345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.059649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.060302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:13.060598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.062203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.067659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1093/2202] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:13.072455 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.081074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1110/2203] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:55:13.082208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.099507 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38cb2-ee89-421d-910c-17e6352ecc24 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.099671 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f732-c4aa-46d1-a191-7deb9788b186 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.105860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.106529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.106684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.106993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.107208 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.107320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.107881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.108052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.108154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] PATH_INFO: `/v3/projects/a3ae98bde67447d09a9cda491b46ecdc/users/4e9a8d0bfe404695aac2758db670f248/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.109991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.110557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3ae98bde67447d09a9cda491b46ecdc, user_id=4e9a8d0bfe404695aac2758db670f248, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.113287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.116938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:13.127519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1094/2204] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:13 2022] PUT /identity/v3/projects/a3ae98bde67447d09a9cda491b46ecdc/users/4e9a8d0bfe404695aac2758db670f248/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:13.156726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1111/2205] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:13 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:13.161103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.308895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb78c6-f8f6-4b42-8f04-1fe03dae9e9a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.393822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.395009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.395385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.395817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.397942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.400330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.440178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1095/2206] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:13 2022] POST /identity/v3/users => generated 283 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:13.444612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.462154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad18b6f-8ada-4b6c-b8eb-75818f7e6386 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.468528 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.469382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.469774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.470228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.471555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.472938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.489167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1112/2207] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:13.490480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.504240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a806cca-54ed-4678-aaf7-5b891b2fed36 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.510242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.512243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.512905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.513305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.514074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.516678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e0914-665f-4a48-a40d-786052cebaf6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.533462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1096/2208] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:13.539498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.551287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935dca-7dcf-4d05-9426-8a546c872ad8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.556716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.557533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.558652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.558998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] PATH_INFO: `/v3/projects/214f7e4436584e8f93fe82798334fe31/users/72d2fcb8b49b4d95822a7e0847cdb5b8/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.579889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] RBAC: Authorizing `identity:create_grant(project_id=214f7e4436584e8f93fe82798334fe31, user_id=72d2fcb8b49b4d95822a7e0847cdb5b8, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.582924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.603851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1113/2209] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:13 2022] PUT /identity/v3/projects/214f7e4436584e8f93fe82798334fe31/users/72d2fcb8b49b4d95822a7e0847cdb5b8/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:13.616445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.617200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.618177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.717915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] MFA Rules not processed for user `72d2fcb8b49b4d95822a7e0847cdb5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:13.720065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:13.750752 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:13.837324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1097/2210] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:13.842650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.930228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450689ae-477d-4ffa-a44e-46200955131b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:13.935122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:13.935855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:13.936211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:13.936945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:13.937748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:13.939722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:13.969678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1114/2211] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:13 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:13.973878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:13.986546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e186e635-ee9f-4c8e-8074-ecc2e5f71532 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.046182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.046809 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.047263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.047572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.048206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.050625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.075277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1098/2212] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:13 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:14.079024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:14.091990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322cb76d-19b0-4d33-8563-345610aa72eb admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.098266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.098910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.099188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.099656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.100544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.102288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.115329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1115/2213] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:14.123684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:14.142111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185bef6-01d2-4596-80e9-6ee463eeb926 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.158446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.159612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.161073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.165172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] PATH_INFO: `/v3/projects/d383f86b8bc6456cb397ef3433b1d035/users/dbf7c2cb976c47f992d8bbb2239994db/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.193779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d383f86b8bc6456cb397ef3433b1d035, user_id=dbf7c2cb976c47f992d8bbb2239994db, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.196532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.213405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1099/2214] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:14 2022] PUT /identity/v3/projects/d383f86b8bc6456cb397ef3433b1d035/users/dbf7c2cb976c47f992d8bbb2239994db/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:14.217213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:14.229716 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7afa-bb2b-4f9c-b1bf-0fb8c3e0affd admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.295348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.295990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.296274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.296542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.297530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.298755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ec026-2bc5-44aa-b7ac-0c9492f5de49 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.310823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1116/2215] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:14.314705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:14.333226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17b73e-a214-4aec-bedf-9a3d95d5d463 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.338437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.339078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.339359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.340795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] PATH_INFO: `/v3/projects/d383f86b8bc6456cb397ef3433b1d035/users/dbf7c2cb976c47f992d8bbb2239994db/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.342190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d383f86b8bc6456cb397ef3433b1d035, user_id=dbf7c2cb976c47f992d8bbb2239994db, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.346574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.373577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1100/2216] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:14 2022] PUT /identity/v3/projects/d383f86b8bc6456cb397ef3433b1d035/users/dbf7c2cb976c47f992d8bbb2239994db/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:14.375462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.375777 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.376053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.429369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] MFA Rules not processed for user `dbf7c2cb976c47f992d8bbb2239994db`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:14.432010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:14.446561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:14.548925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1117/2217] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:14.563292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:14.566631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:14.713697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b998b3-49d6-430e-ac77-56dd62e8f70d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:14.718953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:14.719712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:14.719999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:14.720276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:14.738297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:14.739775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ec120-3eed-46dd-93bd-0c014b3a4d1b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:14.767313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1101/2218] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:14 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:15.482001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:15.631411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae6dd-1f01-4775-b669-9f742e26a0e6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:15.643335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:15.644566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:15.645332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:15.646191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] PATH_INFO: `/v3/users/72d2fcb8b49b4d95822a7e0847cdb5b8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:15.648089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72d2fcb8b49b4d95822a7e0847cdb5b8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:15.652008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:15.731741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72d2fcb8b49b4d95822a7e0847cdb5b8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:15.732406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72d2fcb8b49b4d95822a7e0847cdb5b8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:15.733042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72d2fcb8b49b4d95822a7e0847cdb5b8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:15.741400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72d2fcb8b49b4d95822a7e0847cdb5b8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:15.750105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72d2fcb8b49b4d95822a7e0847cdb5b8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:15.795077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1118/2219] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:15 2022] DELETE /identity/v3/users/72d2fcb8b49b4d95822a7e0847cdb5b8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:15.799645 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:15.800119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:15.800224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:15.825689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:15.827126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:15.837099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:15.914425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1102/2220] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:15.929018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:15.930481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:15.978566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:16.027782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323fc1b-d839-4150-a874-38bba6ab993c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:16.032534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:16.033349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:16.033778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:16.034194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:16.049655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:16.051488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:16.065782 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1119/2221] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:16.559753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:16.562548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:16.608518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06c2b3-936d-46b8-8751-3d5c525503a0 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:16.629262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:16.630790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:16.633577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:16.634474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] PATH_INFO: `/v3/projects/214f7e4436584e8f93fe82798334fe31` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:16.637375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214f7e4436584e8f93fe82798334fe31)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:16.643396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:16.790922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214f7e4436584e8f93fe82798334fe31', 'request_id': 'req-37c93a2b-817b-46a4-854f-52427f87a633'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:16.803110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214f7e4436584e8f93fe82798334fe31', 'request_id': 'req-37c93a2b-817b-46a4-854f-52427f87a633'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:16.829628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214f7e4436584e8f93fe82798334fe31', 'request_id': 'req-37c93a2b-817b-46a4-854f-52427f87a633'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:16.875573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] The token cache is being invalidate because project 214f7e4436584e8f93fe82798334fe31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:16.876131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:16.877747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:16.885018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1103/2222] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:16 2022] DELETE /identity/v3/projects/214f7e4436584e8f93fe82798334fe31 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:16.890769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:16.922087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce7dbb-964a-4fdf-858a-1d5a5880fdfb service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:17.082881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:17.084733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:17.085029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:17.085301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] PATH_INFO: `/v3/users/dbf7c2cb976c47f992d8bbb2239994db` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:17.087400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf7c2cb976c47f992d8bbb2239994db)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:17.092198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:17.210409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf7c2cb976c47f992d8bbb2239994db'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:17.211407 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf7c2cb976c47f992d8bbb2239994db'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:17.212231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf7c2cb976c47f992d8bbb2239994db'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:17.225928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf7c2cb976c47f992d8bbb2239994db'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:17.244052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7caa5962-4bcf-448a-ae8d-013c393366cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf7c2cb976c47f992d8bbb2239994db'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:17.280594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1120/2223] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:16 2022] DELETE /identity/v3/users/dbf7c2cb976c47f992d8bbb2239994db => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:18.115111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.116607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:18.138819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c93a2b-817b-46a4-854f-52427f87a633 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.266160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.266902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.267184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.267461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] PATH_INFO: `/v3/projects/d383f86b8bc6456cb397ef3433b1d035` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.268737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d383f86b8bc6456cb397ef3433b1d035)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.270798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.354661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:18.372037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd383f86b8bc6456cb397ef3433b1d035', 'request_id': 'req-44e22532-723f-496b-a109-c30cf4f3304f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.383783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd383f86b8bc6456cb397ef3433b1d035', 'request_id': 'req-44e22532-723f-496b-a109-c30cf4f3304f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.392562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd383f86b8bc6456cb397ef3433b1d035', 'request_id': 'req-44e22532-723f-496b-a109-c30cf4f3304f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.427444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] The token cache is being invalidate because project d383f86b8bc6456cb397ef3433b1d035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:18.428301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.430339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-44e22532-723f-496b-a109-c30cf4f3304f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:18.433187 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1104/2224] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:18 2022] DELETE /identity/v3/projects/d383f86b8bc6456cb397ef3433b1d035 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:18.439374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08302c8-2793-4480-bd00-188684b6069f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.439923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08302c8-2793-4480-bd00-188684b6069f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.440017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08302c8-2793-4480-bd00-188684b6069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.473553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f08302c8-2793-4480-bd00-188684b6069f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:18.477016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f08302c8-2793-4480-bd00-188684b6069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:18.544367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:18.569265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1121/2225] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:18.577397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.577813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.579526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.627621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:18.629429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:18.639583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1105/2226] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:18.644178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08302c8-2793-4480-bd00-188684b6069f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.655005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08302c8-2793-4480-bd00-188684b6069f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.661572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.662348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.662554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.662819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.663420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:18.663757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.665744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.681116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1122/2227] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:18.685789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.696512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0dba9e-44a0-4475-a7fb-3fed06df1942 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.704396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.705389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.705679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.706267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.706584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.721213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.780929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1106/2228] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:18 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:18.785123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.797831 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc7b075-a100-416a-a694-9e7e1b0664ab admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.918070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.919757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.923694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.923694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.923694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.923694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.954487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1123/2229] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:18 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:18.958559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:18.971443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a6cd5-724e-4e13-a4fd-a2939554deec admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:18.978142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:18.978885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:18.979298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:18.981236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:18.981236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:18.982373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:18.995347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1107/2230] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:18.998800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.019578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b884677-cb28-4443-a3fb-754cb83172f9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.028890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.029540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.029821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.030094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.031647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.034334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2331625-cf99-48ea-ae59-41ce15d59674 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.068645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1124/2231] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:19.072551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.086520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5cee4-bcc2-4e49-85d2-82b0c981e580 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.094391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.095368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.096627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.097056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] PATH_INFO: `/v3/projects/06cbe7e6ff2b4054890f14a9c9049a5a/users/3d7af84d57024024b0e68bc352461500/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.136705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cbe7e6ff2b4054890f14a9c9049a5a, user_id=3d7af84d57024024b0e68bc352461500, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.141367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.186744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1108/2232] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:19 2022] PUT /identity/v3/projects/06cbe7e6ff2b4054890f14a9c9049a5a/users/3d7af84d57024024b0e68bc352461500/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:19.188299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.188989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.189367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.247116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] MFA Rules not processed for user `3d7af84d57024024b0e68bc352461500`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:19.248679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.399537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1125/2233] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:19.404821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.502093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd35b2-5285-4659-aa35-05c1d4ea0516 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.508804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.509529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.510008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.511038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.512512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.514694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.553018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1109/2234] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:19.556884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.571933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fa7cc9-6b54-4497-8f7c-ac5dbe788d15 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.626483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:19.648409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.649331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.649797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.650241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.651756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.653868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.691957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1126/2235] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:19.693105 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.705623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70168e21-d033-4bca-b0da-87a2c6f4cc4e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.711636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.712403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.712710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.713027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.714207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.715908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f1ec00-9bdf-45ed-bbc4-1054fc8bf169 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.731454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1110/2236] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:19.733178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.734209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969473e7-9569-4213-ae67-0f91e086323a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.734644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969473e7-9569-4213-ae67-0f91e086323a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.735272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969473e7-9569-4213-ae67-0f91e086323a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.745192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bc1ad-3919-457a-b9a1-e2d3bd0f2ea7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.751666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.752432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.752720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.752995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] PATH_INFO: `/v3/projects/e1a4d871df144255a399f5fa312f746c/users/1efcf2566bea4db4aa606fbe34389f4b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.777753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-969473e7-9569-4213-ae67-0f91e086323a None None] MFA Rules not processed for user `4e9a8d0bfe404695aac2758db670f248`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:19.779020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-969473e7-9569-4213-ae67-0f91e086323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.781517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a4d871df144255a399f5fa312f746c, user_id=1efcf2566bea4db4aa606fbe34389f4b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.784588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.814871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:19.815486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1127/2237] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:19 2022] PUT /identity/v3/projects/e1a4d871df144255a399f5fa312f746c/users/1efcf2566bea4db4aa606fbe34389f4b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:19.819826 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.899935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1111/2238] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:19.934407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969473e7-9569-4213-ae67-0f91e086323a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.936048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-969473e7-9569-4213-ae67-0f91e086323a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:19.949798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c230eac-6727-4255-bcd3-255870794444 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:19.954718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:19.955329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:19.955641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:19.955913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:19.956635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:19.958127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:19.978312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1128/2239] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:19.983346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:19.998480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384eeb-0f7c-4bfb-9d8d-e77e436062a8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.005069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.006043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.007063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.007443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] PATH_INFO: `/v3/projects/e1a4d871df144255a399f5fa312f746c/users/1efcf2566bea4db4aa606fbe34389f4b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.010317 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a4d871df144255a399f5fa312f746c, user_id=1efcf2566bea4db4aa606fbe34389f4b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.013956 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e527f77b-077c-4e47-9417-6c6796b03f9e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.025264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969473e7-9569-4213-ae67-0f91e086323a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.025988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1129/2240] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:19 2022] PUT /identity/v3/projects/e1a4d871df144255a399f5fa312f746c/users/1efcf2566bea4db4aa606fbe34389f4b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:20.037776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.038067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.038348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.089226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] MFA Rules not processed for user `1efcf2566bea4db4aa606fbe34389f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:20.090500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.093588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.094261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.094550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.095018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.097440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.172853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.174652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.180111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1130/2241] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:20.185595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1112/2242] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:20.197330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.199351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.222615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.275211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4aed2-64f2-4f87-ad22-d8ebc326ad0a None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.280690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.292772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.293067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.293343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.310532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.312352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee044a1f-7d3e-4fd9-82c1-4f885ae311e9 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.326109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1131/2243] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:20 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:20.361262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.405159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.455110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.455394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.455717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.462643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3750ce-c794-4c5b-8561-a6d43750c31a service glance] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.468270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.469035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.469530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.469920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] PATH_INFO: `/v3/users/3d7af84d57024024b0e68bc352461500` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.476846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7af84d57024024b0e68bc352461500)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.478478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:20.478990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.480431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.589417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1132/2244] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:55:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:20.602123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7af84d57024024b0e68bc352461500'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:20.603076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7af84d57024024b0e68bc352461500'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:20.620927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7af84d57024024b0e68bc352461500'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:20.621566 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7af84d57024024b0e68bc352461500'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:20.636301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2719b529-9b6f-4ecd-b3f0-09caae52f2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7af84d57024024b0e68bc352461500'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:20.650499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.652712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.669603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1113/2245] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:20 2022] DELETE /identity/v3/users/3d7af84d57024024b0e68bc352461500 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:20.673855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.674333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.674614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.701204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:20.702464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.742660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4925577e-3479-4326-bb3e-5126a93044f2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.777433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1114/2246] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:20.787492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:20.789312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.822640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.823363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.823674 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.823961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.826282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:20.842380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.857578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844fc2b-63b3-4702-802a-43af288df2f8 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:20.861365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:20.861977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:20.862253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:20.862526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:20.871396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:20.880621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.882178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.896384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1115/2247] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:20.917682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:20.919877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:20.930157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1133/2248] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:55:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:55:21.356093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:21.357771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:21.380545 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2adc9-2346-4c35-86a6-89acac9ed45a service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:21.397437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:21.398467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:21.399041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:21.399619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] PATH_INFO: `/v3/projects/06cbe7e6ff2b4054890f14a9c9049a5a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:21.402419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06cbe7e6ff2b4054890f14a9c9049a5a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:21.405153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:21.548423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06cbe7e6ff2b4054890f14a9c9049a5a', 'request_id': 'req-bbd952aa-9b4d-477a-b072-cd63a6cb354c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.562688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06cbe7e6ff2b4054890f14a9c9049a5a', 'request_id': 'req-bbd952aa-9b4d-477a-b072-cd63a6cb354c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.578395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06cbe7e6ff2b4054890f14a9c9049a5a', 'request_id': 'req-bbd952aa-9b4d-477a-b072-cd63a6cb354c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.597838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] The token cache is being invalidate because project 06cbe7e6ff2b4054890f14a9c9049a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:21.598128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.598791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.601403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1116/2249] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:21 2022] DELETE /identity/v3/projects/06cbe7e6ff2b4054890f14a9c9049a5a => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:21.605482 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:21.623694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637997b-b66c-46c4-b79b-12033ee0293a service swift] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:21.780143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:21.781006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:21.781619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:21.782030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] PATH_INFO: `/v3/users/1efcf2566bea4db4aa606fbe34389f4b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:21.783660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efcf2566bea4db4aa606fbe34389f4b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:21.786752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:21.860061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efcf2566bea4db4aa606fbe34389f4b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.860760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efcf2566bea4db4aa606fbe34389f4b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.861377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efcf2566bea4db4aa606fbe34389f4b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.890202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efcf2566bea4db4aa606fbe34389f4b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:21.943560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dd26958e-290d-477b-88df-a7869f3ffc30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efcf2566bea4db4aa606fbe34389f4b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.002840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1134/2250] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:21 2022] DELETE /identity/v3/users/1efcf2566bea4db4aa606fbe34389f4b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:22.368873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:22.371056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:22.386711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd952aa-9b4d-477a-b072-cd63a6cb354c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:22.486380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:22.487463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:22.487985 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:22.488505 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] PATH_INFO: `/v3/projects/e1a4d871df144255a399f5fa312f746c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:22.490314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a4d871df144255a399f5fa312f746c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:22.492785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:22.556148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a4d871df144255a399f5fa312f746c', 'request_id': 'req-6766f8c4-3037-4b69-a60a-cd7653d1d641'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.567436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a4d871df144255a399f5fa312f746c', 'request_id': 'req-6766f8c4-3037-4b69-a60a-cd7653d1d641'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.578584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a4d871df144255a399f5fa312f746c', 'request_id': 'req-6766f8c4-3037-4b69-a60a-cd7653d1d641'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.593045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] The token cache is being invalidate because project e1a4d871df144255a399f5fa312f746c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:22.593587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.594419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6766f8c4-3037-4b69-a60a-cd7653d1d641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:22.599650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1117/2251] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:22 2022] DELETE /identity/v3/projects/e1a4d871df144255a399f5fa312f746c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:22.601191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:22.601480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:22.601760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:22.627746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:22.628976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:22.657840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:22.709075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1135/2252] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:22.716953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:22.717238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:22.717513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:22.736709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:22.743295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:22.746311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:22.755995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1118/2253] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:22.762228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:22.781976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb236b5a-1d26-4252-8204-dd3e8988e6b2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:22.787121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:22.787840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:22.788120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:22.788393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:22.789043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:22.789348 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:22.791075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:22.812584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1136/2254] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:22.813681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:22.825656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115c5ed-cc94-4896-98b0-219b2f7a96e5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:22.832651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:22.833268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:22.833542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:22.833810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:22.835951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:22.837911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:22.878028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1119/2255] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:22 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:22.882450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:22.901663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256db637-1fe4-4fcb-821f-f92e6636b0c0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.005491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.006784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.007620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.008050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.009243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.012987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.049756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1137/2256] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:22 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:23.050663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.065584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e05079-239c-4e60-9d02-1529be5093e0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.070839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.071683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.072069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.072530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.074761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.076710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.095427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1120/2257] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:23.095661 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.109728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.110798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d562b-7ac5-42a4-8a11-8a2e2ee99459 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.111456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:23.117213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.118208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.118714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.119200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.121208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.124180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.126247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b1a03-90d0-4637-94c7-bbf4aad9a294 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.132152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.133041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.133312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.133882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] PATH_INFO: `/v3/users/f724a04133e3494a9a0f14618cce9d0c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.135001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f724a04133e3494a9a0f14618cce9d0c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.137660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.138035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1138/2258] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:23.144673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.162697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e347e87-c9ce-453c-b279-518ad495af94 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.172563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.173529 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.173816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.174230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] PATH_INFO: `/v3/projects/10bba2a81b4d466c93241eaf9a2d1bf8/users/351c8da9cc344e6b924e7183099adfcd/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.202532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f724a04133e3494a9a0f14618cce9d0c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:23.203317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f724a04133e3494a9a0f14618cce9d0c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:23.216536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f724a04133e3494a9a0f14618cce9d0c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:23.217224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f724a04133e3494a9a0f14618cce9d0c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:23.234926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2817963d-e0a6-42bd-9bfa-8f53f56632e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f724a04133e3494a9a0f14618cce9d0c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:23.237740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bba2a81b4d466c93241eaf9a2d1bf8, user_id=351c8da9cc344e6b924e7183099adfcd, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.240546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf240c30-6556-4762-bf9c-1af645f97082 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.283954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1139/2259] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:23 2022] PUT /identity/v3/projects/10bba2a81b4d466c93241eaf9a2d1bf8/users/351c8da9cc344e6b924e7183099adfcd/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:23.285462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.285746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.286018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.317531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1121/2260] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:23 2022] DELETE /identity/v3/users/f724a04133e3494a9a0f14618cce9d0c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:23.321451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.321738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.322015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.345064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] MFA Rules not processed for user `351c8da9cc344e6b924e7183099adfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:23.346710 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:23.365166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:23.366408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:23.451414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:23.459449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1140/2261] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:23.466917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.470772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:23.499059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1122/2262] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:23.509646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.512419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:23.587776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:23.609268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6a542c-47f3-4518-9b26-da310c6f1fa9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.616600 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.617493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.618290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.618837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.637167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.639276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.652711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13022b-ebde-4f18-9969-665fb6a74632 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.657695 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1123/2263] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:23.672072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.672860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.673254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.673642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.674364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.676500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.710606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1141/2264] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:23 2022] POST /identity/v3/projects => generated 391 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:23.714794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.726360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b70ed-cb5e-4901-8b45-e947151e1012 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.846220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.846841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.847121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.847392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.848058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.850028 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.903814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1124/2265] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:23 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:23.908512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.926194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c61b0e-d22d-4a55-8295-118832256b56 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.940250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.940933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.941217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.941492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:23.942171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:23.943899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:23.958046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1142/2266] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:23.962726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:23.975638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d698-0edd-4503-a6c7-3849c6273bfc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:23.981814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:23.982748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:23.983171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:23.983779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] PATH_INFO: `/v3/projects/c745dc5b23db48df85e1280d005021f1/users/967ff8c0014f4e019a0852fe91f0d5ee/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.001707 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c745dc5b23db48df85e1280d005021f1, user_id=967ff8c0014f4e019a0852fe91f0d5ee, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.005385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.075886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1125/2267] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:23 2022] PUT /identity/v3/projects/c745dc5b23db48df85e1280d005021f1/users/967ff8c0014f4e019a0852fe91f0d5ee/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:24.076296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.095572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c85f3e-0a32-4b25-94a2-6922609b714d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.106210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.110965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.253992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.254611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.254887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.255154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.255823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.257985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.272764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aca147-284f-4adf-9bd3-d1c781da041e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.283384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1143/2268] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:24.283949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.285044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.285986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.286099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.286305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] PATH_INFO: `/v3/projects/cd58618ca2bf4f0a8e541a9e2ed1674c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.289095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd58618ca2bf4f0a8e541a9e2ed1674c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.291001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.305714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf8a8-f249-4987-8d16-982196af54f3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.316720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.319992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.320270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.320539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] PATH_INFO: `/v3/projects/c745dc5b23db48df85e1280d005021f1/users/967ff8c0014f4e019a0852fe91f0d5ee/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.323971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c745dc5b23db48df85e1280d005021f1, user_id=967ff8c0014f4e019a0852fe91f0d5ee, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.326598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f90e58-d053-4410-b175-1800597503d5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.351238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1144/2269] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:24 2022] PUT /identity/v3/projects/c745dc5b23db48df85e1280d005021f1/users/967ff8c0014f4e019a0852fe91f0d5ee/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:24.364635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.365328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.368302 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.394180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd58618ca2bf4f0a8e541a9e2ed1674c', 'request_id': 'req-ab367efd-052f-4368-9504-9d4dcefc5ed3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:24.395944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:24.405711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd58618ca2bf4f0a8e541a9e2ed1674c', 'request_id': 'req-ab367efd-052f-4368-9504-9d4dcefc5ed3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:24.414681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd58618ca2bf4f0a8e541a9e2ed1674c', 'request_id': 'req-ab367efd-052f-4368-9504-9d4dcefc5ed3'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:24.416096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] MFA Rules not processed for user `967ff8c0014f4e019a0852fe91f0d5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:24.418387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.441477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] The token cache is being invalidate because project cd58618ca2bf4f0a8e541a9e2ed1674c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:24.442078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:24.443673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ab367efd-052f-4368-9504-9d4dcefc5ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:24.446357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1126/2270] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:24 2022] DELETE /identity/v3/projects/cd58618ca2bf4f0a8e541a9e2ed1674c => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:24.452762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddf4d2-2e60-468f-af61-4e564ae78078 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.453825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddf4d2-2e60-468f-af61-4e564ae78078 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.454449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ddf4d2-2e60-468f-af61-4e564ae78078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.497031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a3ddf4d2-2e60-468f-af61-4e564ae78078 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:24.498780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a3ddf4d2-2e60-468f-af61-4e564ae78078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.503554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:24.550312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1145/2271] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:24 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:24.566052 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.570395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.591206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1127/2272] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:24.598430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.599833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.600119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.639060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:24.640589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.646085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7c17a-a2a4-4808-af38-e31f484ad72d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.650100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.650848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.651227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.651552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.657825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1128/2273] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:24.659158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.662593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.664140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.677090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1146/2274] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:24.696942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f78d9e-5b3a-4bae-8286-0791e1f23afc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.703354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.704077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.704422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.704756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.706080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:24.706371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.707997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.725871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1129/2275] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:24.731773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.743415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bfb83-b528-4bc4-9718-567bcf60d3a4 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.744045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.748698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.750178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.750879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.751231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.751627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.752517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.755324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.770330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0285cc-b5a6-45c0-b498-1262be259282 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.774439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.775217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.775825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.776313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.778537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:24.796544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1147/2276] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:24 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:24.800544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:24.872408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.873808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:24.888304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1130/2277] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:24 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:24.958417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25902a2-e40a-4474-a741-a9e1e734099b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:24.981183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:24.982151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:24.982592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:24.983011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:24.983835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:24.988170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:25.029223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1148/2278] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:24 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:25.031064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:25.051845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad348f7-29a9-4297-9ee3-65050cba2a71 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:25.078564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:25.079195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:25.079508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:25.079783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:25.080439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:25.082942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:25.117094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1131/2279] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:25.122224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:25.136521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706e0bc-0431-43b1-8063-f49ddae59900 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:25.144497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:25.145186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:25.145469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:25.145742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:25.146400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:25.151797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f393f-715f-4ce8-8b2c-e9b8f850ee6e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:25.183542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1149/2280] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:25.184978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:25.221676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaee6a4-8bce-4ec0-83c6-a798a65c0f84 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:25.236462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:25.237138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:25.241287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:25.241287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] PATH_INFO: `/v3/projects/f9918f92fc9f46d18883a0d6335744a0/users/3471f2d8c7e9409b8ca57fb60ce876e4/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:25.295258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9918f92fc9f46d18883a0d6335744a0, user_id=3471f2d8c7e9409b8ca57fb60ce876e4, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:25.302352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:25.337642 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1132/2281] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:25 2022] PUT /identity/v3/projects/f9918f92fc9f46d18883a0d6335744a0/users/3471f2d8c7e9409b8ca57fb60ce876e4/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:25.340539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b188-5a44-4f9b-ad20-b56f1fffa608 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:25.340807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b188-5a44-4f9b-ad20-b56f1fffa608 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:25.341126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7b188-5a44-4f9b-ad20-b56f1fffa608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:25.386404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-bee7b188-5a44-4f9b-ad20-b56f1fffa608 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:25.389066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-bee7b188-5a44-4f9b-ad20-b56f1fffa608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:25.462927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:25.529559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1150/2282] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:25.546761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:25.551996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:25.631966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:25.707134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4180e6a-2e13-41ed-a881-55071901d894 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:25.716100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:25.716827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:25.717116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:25.717392 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:25.739183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:25.740989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:25.758564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1133/2283] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:26.917971 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275dcfc-1b68-48f3-9adc-acd60f11fb54 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:26.918486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275dcfc-1b68-48f3-9adc-acd60f11fb54 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:26.918578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275dcfc-1b68-48f3-9adc-acd60f11fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:26.966545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4275dcfc-1b68-48f3-9adc-acd60f11fb54 None None] MFA Rules not processed for user `3471f2d8c7e9409b8ca57fb60ce876e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:26.967808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4275dcfc-1b68-48f3-9adc-acd60f11fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:27.111103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1151/2284] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:27.124541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:27.221067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf046f-aa25-4454-b63b-238089ef169a service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:27.231298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:27.233383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:27.233690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:27.233972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:27.248506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:27.250008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:27.285567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1134/2285] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:28.895812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e514f-1be8-4017-aeae-56f4ca7ae801 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:28.896398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e514f-1be8-4017-aeae-56f4ca7ae801 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:28.896398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e514f-1be8-4017-aeae-56f4ca7ae801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:28.936944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-542e514f-1be8-4017-aeae-56f4ca7ae801 None None] MFA Rules not processed for user `3471f2d8c7e9409b8ca57fb60ce876e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:28.938669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-542e514f-1be8-4017-aeae-56f4ca7ae801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:28.951612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1152/2286] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:29.502127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.503760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:29.528486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419a6974-d6cc-47f0-874c-11b0021f40e7 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:29.537900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:29.538767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.539193 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.539679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] PATH_INFO: `/v3/users/351c8da9cc344e6b924e7183099adfcd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.540982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=351c8da9cc344e6b924e7183099adfcd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:29.543170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:29.625925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '351c8da9cc344e6b924e7183099adfcd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:29.635788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '351c8da9cc344e6b924e7183099adfcd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:29.654812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '351c8da9cc344e6b924e7183099adfcd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:29.656708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '351c8da9cc344e6b924e7183099adfcd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:29.669599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '351c8da9cc344e6b924e7183099adfcd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:29.702534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1135/2287] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:29 2022] DELETE /identity/v3/users/351c8da9cc344e6b924e7183099adfcd => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:29.707209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:29.707815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:29.708346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:29.746760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:29.750097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:29.912226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1153/2288] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:29.925538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:29.927000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.037399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.066631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562fff7-6049-4e80-a4dd-dcc6ab6dcf1f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.070951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.071685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.072142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.073391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.087029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.089346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.115872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1136/2289] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:30.503851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:30.505303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:30.526369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d995bb-bed6-4afc-b28c-532adc955d89 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.535773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.536567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.537091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.537481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] PATH_INFO: `/v3/projects/10bba2a81b4d466c93241eaf9a2d1bf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.539044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bba2a81b4d466c93241eaf9a2d1bf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.541230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.626704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bba2a81b4d466c93241eaf9a2d1bf8', 'request_id': 'req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.633161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bba2a81b4d466c93241eaf9a2d1bf8', 'request_id': 'req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.639616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:30.647376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bba2a81b4d466c93241eaf9a2d1bf8', 'request_id': 'req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.675488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] The token cache is being invalidate because project 10bba2a81b4d466c93241eaf9a2d1bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:30.676083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.677477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.680489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1154/2290] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:30 2022] DELETE /identity/v3/projects/10bba2a81b4d466c93241eaf9a2d1bf8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:30.685224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:30.698866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3384b6-4ff9-4047-81c7-881975519e64 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:30.775164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:30.776655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:30.776930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:30.777195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] PATH_INFO: `/v3/users/967ff8c0014f4e019a0852fe91f0d5ee` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:30.778337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967ff8c0014f4e019a0852fe91f0d5ee)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:30.781062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:30.856071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967ff8c0014f4e019a0852fe91f0d5ee'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.857056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967ff8c0014f4e019a0852fe91f0d5ee'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.872644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967ff8c0014f4e019a0852fe91f0d5ee'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.873405 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967ff8c0014f4e019a0852fe91f0d5ee'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.881741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-69ff2751-4599-4481-9773-140d0709c975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967ff8c0014f4e019a0852fe91f0d5ee'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:30.916340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1137/2291] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:30 2022] DELETE /identity/v3/users/967ff8c0014f4e019a0852fe91f0d5ee => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:31.272583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.274053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:31.299109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37b60c-e1ee-4c7b-95bb-a74c843f772e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.411859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.412607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.413001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.413356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] PATH_INFO: `/v3/projects/c745dc5b23db48df85e1280d005021f1` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.414682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c745dc5b23db48df85e1280d005021f1)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.417436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:31.532514 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c745dc5b23db48df85e1280d005021f1', 'request_id': 'req-9e61a3a1-58bf-4d14-9203-41c657bab1eb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.546144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c745dc5b23db48df85e1280d005021f1', 'request_id': 'req-9e61a3a1-58bf-4d14-9203-41c657bab1eb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.568830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c745dc5b23db48df85e1280d005021f1', 'request_id': 'req-9e61a3a1-58bf-4d14-9203-41c657bab1eb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.593981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] The token cache is being invalidate because project c745dc5b23db48df85e1280d005021f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:31.596667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.599377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9e61a3a1-58bf-4d14-9203-41c657bab1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:31.610034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1155/2292] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:31 2022] DELETE /identity/v3/projects/c745dc5b23db48df85e1280d005021f1 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:31.612006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.612320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.612641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.662148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:31.663454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:31.810499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1138/2293] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:31.818086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.818373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.818645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.868341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:31.869921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:31.881180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1156/2294] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:31.885897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.891165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:31.904002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc760ec6-eeb1-48ff-a100-ef64ab75f78b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.916971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.919720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.921216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.923085 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.924774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:31.928241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.933376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:31.961727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1139/2295] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:31.966786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:31.983078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10af6c-625c-4f4a-b634-b0b596be4a6c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:31.990613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:31.992607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:31.993178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:31.993662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:31.995745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:31.997955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.042213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1157/2296] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:31 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:32.046582 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.058107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653bec8-fb1a-45ee-a7b1-34fbd5eb7aaa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.150135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.151273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.152292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.152292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.153315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.156340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.194830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1140/2297] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:32.195727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.215552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638dfe9-533c-4e40-aa8c-b43d903d26c8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.221635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.222272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.222550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.222914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.223593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.225269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.241353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1158/2298] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:32.245874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.258048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5057fa-46a2-40be-a7c9-a00c0a755c64 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.263400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.264082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.264376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.264637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.265281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.267227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0a47a-80ba-4c84-9fab-d745e11fa9e6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.283433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1141/2299] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:32.288077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.311677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13647c94-d671-4d5e-8630-4359eff6c840 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.318575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.320652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.321147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.321623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] PATH_INFO: `/v3/projects/a3e8bdcf54484dac8374d824cdbee66d/users/33b791cf89a347e491e1a329a2b8f521/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.342017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e8bdcf54484dac8374d824cdbee66d, user_id=33b791cf89a347e491e1a329a2b8f521, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.344762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.363172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1159/2300] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:32 2022] PUT /identity/v3/projects/a3e8bdcf54484dac8374d824cdbee66d/users/33b791cf89a347e491e1a329a2b8f521/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:32.375146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.375450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.375835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.407371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] MFA Rules not processed for user `33b791cf89a347e491e1a329a2b8f521`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:32.408639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:32.529147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1142/2301] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:32.530890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.554808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:32.627576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fef9f8-2a1a-4c16-8a27-dd7283287654 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.636013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.636846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.637178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.637554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.638610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.641762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.684205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.692095 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1160/2302] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:32.697115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cc7d59-3bbb-4e4b-a4f5-5b3b70e45a70 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.768168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:32.787743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.788375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.792513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.792513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.793383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.795843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.826798 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1143/2303] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:32 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:32.830457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.844888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9116caa-9ec2-4bdc-8897-a98846376c9d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.850586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.851301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.851856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.852202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.853109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.855518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.873783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1161/2304] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:32.875425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.896005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb302cbb-8c3a-4aeb-9071-9885ec0fdb6f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.905287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.905924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.906207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.906618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.908753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:32.912313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632df4a-f149-4887-b112-0b7aeb75ce16 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:32.940652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1144/2305] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:32 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:32.943268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:32.964551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a42d1-36fc-42ad-8e82-d7452ac4b486 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:32.973405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:32.973405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:32.973405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:32.973405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] PATH_INFO: `/v3/projects/f7f7f8f9fc9b4f5fa1d8fd808604e5f4/users/91940e6642d14ebfab25cd331323059e/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:32.999162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f7f8f9fc9b4f5fa1d8fd808604e5f4, user_id=91940e6642d14ebfab25cd331323059e, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.002164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.041349 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1162/2306] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:32 2022] PUT /identity/v3/projects/f7f7f8f9fc9b4f5fa1d8fd808604e5f4/users/91940e6642d14ebfab25cd331323059e/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:33.050915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.051236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.051494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.089361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] MFA Rules not processed for user `91940e6642d14ebfab25cd331323059e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:33.090617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:33.271767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1145/2307] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:33.294070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.445849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0aec9-7ca0-42e3-9887-339a006c5399 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.456361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.456361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.456361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.456361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.456886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.456886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.525447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1163/2308] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:33.531959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.555416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da46126-866a-4fb7-ac7d-13c62837222e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.647002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.648330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.650000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.650560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.651772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.655633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.698653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1146/2309] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:33 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:33.699549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.717012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ca125-c817-4434-8b2f-599d82d63643 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.725816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.725816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.725816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.725816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.726201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.727752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.745233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.753273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1164/2310] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:33.757746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6e665-940f-4610-bd4c-e8b1e0090b0e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.763404 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.764106 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.764510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.764791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] PATH_INFO: `/v3/projects/9150afb6573841cb9cb40cc208086d64/users/08fbedfb79e3430dad397596e5564dbb/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.784284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150afb6573841cb9cb40cc208086d64, user_id=08fbedfb79e3430dad397596e5564dbb, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.788080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.814869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1147/2311] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:33 2022] PUT /identity/v3/projects/9150afb6573841cb9cb40cc208086d64/users/08fbedfb79e3430dad397596e5564dbb/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:33.818921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.834086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fe2c6-03d2-4a5c-9ee4-941b13f4196f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.892198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:33.923917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.924568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.925440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.925724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.926704 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.928613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61782a35-f881-4adb-a30b-33d2a1dd22ad admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:33.945700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1165/2312] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:33.956348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:33.970128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8a359-4a0e-44cb-a9de-25267ac017fd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:33.982749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:33.983410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:33.983717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:33.984007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] PATH_INFO: `/v3/projects/9150afb6573841cb9cb40cc208086d64/users/08fbedfb79e3430dad397596e5564dbb/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:33.986337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9150afb6573841cb9cb40cc208086d64, user_id=08fbedfb79e3430dad397596e5564dbb, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:33.988793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:34.001380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1148/2313] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:33 2022] PUT /identity/v3/projects/9150afb6573841cb9cb40cc208086d64/users/08fbedfb79e3430dad397596e5564dbb/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:34.012849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebfc3-bfc5-485d-8bbe-51d367cf687c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:34.013180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebfc3-bfc5-485d-8bbe-51d367cf687c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:34.013408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ebfc3-bfc5-485d-8bbe-51d367cf687c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:34.050569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6e6ebfc3-bfc5-485d-8bbe-51d367cf687c None None] MFA Rules not processed for user `08fbedfb79e3430dad397596e5564dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:34.053568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6e6ebfc3-bfc5-485d-8bbe-51d367cf687c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:34.153146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1166/2314] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:34.164860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:34.166679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:34.188548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:34.193159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:34.193612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:34.194163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:34.216143 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] MFA Rules not processed for user `bf41bacfc4214e26bfbbeafe7186bf37`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:34.217356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:34.233403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b515ab9-7a09-408e-abd9-13b54d365cbe admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:34.239629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:34.240887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:34.241365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:34.242448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:34.254577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:34.256270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:34.267940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1149/2315] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:34.279985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1167/2316] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:34.319922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:34.321742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:34.334682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1857eb0-6a58-44a8-a30c-9235472d4e69 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:34.343782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:34.344413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:34.344696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:34.344970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:34.449876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:34.451500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1322e2-4f9c-4e51-9f43-370a9da4f42b service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:34.463818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1150/2317] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:37.580715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:37.643641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef5cef-bce1-4948-aa94-f58fcff4f6bc None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:37.648286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:37.648919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:37.649199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:37.649472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] PATH_INFO: `/v3/users/33b791cf89a347e491e1a329a2b8f521` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:37.651318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b791cf89a347e491e1a329a2b8f521)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:37.653327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:37.658802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:37.703461 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b791cf89a347e491e1a329a2b8f521'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:37.704129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b791cf89a347e491e1a329a2b8f521'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:37.704726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b791cf89a347e491e1a329a2b8f521'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:37.711534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b791cf89a347e491e1a329a2b8f521'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:37.719902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b791cf89a347e491e1a329a2b8f521'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:37.736934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1168/2318] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:37 2022] DELETE /identity/v3/users/33b791cf89a347e491e1a329a2b8f521 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:37.741364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:37.741822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:37.741927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:37.761705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:37.762993 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:37.825601 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1151/2319] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:37.835715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:37.837188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:37.903932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b4ccc-5d24-416a-9fa0-bf1e27a56c35 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:37.907681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:37.908323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:37.908603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:37.908877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:37.918343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:37.920068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:37.929491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1169/2320] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:38.277797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:38.279610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:38.293072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed724c3-e6e3-4cac-aed8-3d36b9106236 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:38.298025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:38.298655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:38.298926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:38.299191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] PATH_INFO: `/v3/projects/a3e8bdcf54484dac8374d824cdbee66d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:38.300343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e8bdcf54484dac8374d824cdbee66d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:38.302229 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:38.354365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e8bdcf54484dac8374d824cdbee66d', 'request_id': 'req-00ff79f5-7c27-4cc9-b7dd-73cc84841792'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.362056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e8bdcf54484dac8374d824cdbee66d', 'request_id': 'req-00ff79f5-7c27-4cc9-b7dd-73cc84841792'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.363325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:38.370160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e8bdcf54484dac8374d824cdbee66d', 'request_id': 'req-00ff79f5-7c27-4cc9-b7dd-73cc84841792'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.389904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] The token cache is being invalidate because project a3e8bdcf54484dac8374d824cdbee66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:38.390509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.391139 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.392834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1152/2321] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:38 2022] DELETE /identity/v3/projects/a3e8bdcf54484dac8374d824cdbee66d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:38.396896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:38.415254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8dac33-af3a-488a-b367-e6975b2a9af6 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:38.496132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:38.496775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:38.497053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:38.497328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] PATH_INFO: `/v3/users/91940e6642d14ebfab25cd331323059e` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:38.498456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91940e6642d14ebfab25cd331323059e)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:38.500517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:38.534998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:38.550570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91940e6642d14ebfab25cd331323059e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.551273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91940e6642d14ebfab25cd331323059e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.551946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91940e6642d14ebfab25cd331323059e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.558931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91940e6642d14ebfab25cd331323059e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.565990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91940e6642d14ebfab25cd331323059e'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.583833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1170/2322] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:38 2022] DELETE /identity/v3/users/91940e6642d14ebfab25cd331323059e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:38.857784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:38.859377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:38.875157 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff79f5-7c27-4cc9-b7dd-73cc84841792 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:38.933209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:38.933872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:38.934153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:38.934427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] PATH_INFO: `/v3/projects/f7f7f8f9fc9b4f5fa1d8fd808604e5f4` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:38.935573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f7f8f9fc9b4f5fa1d8fd808604e5f4)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:38.937471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:38.983593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f7f8f9fc9b4f5fa1d8fd808604e5f4', 'request_id': 'req-38a4bb0f-cc5b-403e-a80a-cb632489ad83'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.989583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f7f8f9fc9b4f5fa1d8fd808604e5f4', 'request_id': 'req-38a4bb0f-cc5b-403e-a80a-cb632489ad83'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:38.995066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f7f8f9fc9b4f5fa1d8fd808604e5f4', 'request_id': 'req-38a4bb0f-cc5b-403e-a80a-cb632489ad83'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.007127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] The token cache is being invalidate because project f7f7f8f9fc9b4f5fa1d8fd808604e5f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:39.007409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.008047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.010012 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1153/2323] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:38 2022] DELETE /identity/v3/projects/f7f7f8f9fc9b4f5fa1d8fd808604e5f4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:39.014209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:39.016344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.030038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b37f2-451c-41fb-bae1-b75497a8ece7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:39.087537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:39.088733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.089007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.089275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] PATH_INFO: `/v3/users/08fbedfb79e3430dad397596e5564dbb` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.090431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fbedfb79e3430dad397596e5564dbb)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:39.092376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:39.139157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fbedfb79e3430dad397596e5564dbb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.139852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fbedfb79e3430dad397596e5564dbb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.140475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fbedfb79e3430dad397596e5564dbb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.147226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fbedfb79e3430dad397596e5564dbb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.155629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-ddf03680-6b16-45af-aef0-cffe1ba9fcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fbedfb79e3430dad397596e5564dbb'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.173181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1171/2324] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:39 2022] DELETE /identity/v3/users/08fbedfb79e3430dad397596e5564dbb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:39.308535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:39.311087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.331079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4bb0f-cc5b-403e-a80a-cb632489ad83 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:39.419674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:39.420303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.420549 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.420820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] PATH_INFO: `/v3/users/d9b02cb26d9645c9b8ef5871b0b9e194` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.422127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b02cb26d9645c9b8ef5871b0b9e194)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:39.424370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:39.441004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:39.485861 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b02cb26d9645c9b8ef5871b0b9e194'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.496169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b02cb26d9645c9b8ef5871b0b9e194'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.517664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b02cb26d9645c9b8ef5871b0b9e194'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.519570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b02cb26d9645c9b8ef5871b0b9e194'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.531990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-21e14aa0-fc07-48ef-a291-eb701af0a7c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b02cb26d9645c9b8ef5871b0b9e194'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:39.577475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1154/2325] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:39 2022] DELETE /identity/v3/users/d9b02cb26d9645c9b8ef5871b0b9e194 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:39.582210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.582497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.582800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.603952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:39.605188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.628097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:39.720567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.721271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.721643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.723845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1172/2326] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:39.745470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:39.747830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.749402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:39.750856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.830627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1155/2327] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:55:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:39.849090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:39.851371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.866934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6437-7a19-4815-b7c4-6b3d5dc460a3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:39.872090 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:39.872758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.873340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.873622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.887344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:39.888855 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:39.913255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1173/2328] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:39.914530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:39.918207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:39.956311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424148eb-f128-4812-9f5f-036164f1830a service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:39.966376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:39.967396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.968094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.968527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] PATH_INFO: `/v3/projects/9150afb6573841cb9cb40cc208086d64` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.971526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9150afb6573841cb9cb40cc208086d64)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:39.973377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85710bb2-baa1-455e-8985-ef7ccc68beca None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:39.973830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:39.982576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:39.983202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:39.983615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:39.983882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:39.997370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:39.999657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ee3e6-bb37-41c7-bef5-6f2abc0711d7 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.011800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1156/2329] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:55:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:55:40.046283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9150afb6573841cb9cb40cc208086d64', 'request_id': 'req-2d66353b-bafc-4aab-afcd-ea9e1422a879'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.054951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9150afb6573841cb9cb40cc208086d64', 'request_id': 'req-2d66353b-bafc-4aab-afcd-ea9e1422a879'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.065947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9150afb6573841cb9cb40cc208086d64', 'request_id': 'req-2d66353b-bafc-4aab-afcd-ea9e1422a879'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.080608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] The token cache is being invalidate because project 9150afb6573841cb9cb40cc208086d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:40.080986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.081740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2d66353b-bafc-4aab-afcd-ea9e1422a879 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.083679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1174/2330] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:39 2022] DELETE /identity/v3/projects/9150afb6573841cb9cb40cc208086d64 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:40.090471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.090730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.090997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.112097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:40.113327 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.139175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:40.200104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1157/2331] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:40.207395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.207395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.207395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.235065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:40.236432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.250315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.257673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1175/2332] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:40.263307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ad6b7-7f7a-4b29-8afa-f117b6a7df00 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.269281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.270172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.270498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.270839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.271654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:40.272022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.274312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.305563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1158/2333] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:55:40.311548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.326250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaae681-462c-4bed-9f64-d58ce85406d5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.339570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.341789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.342494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.342772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.344880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.351097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.418112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1176/2334] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:40.422596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.437221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884e4f3-1ae2-41ed-8b84-d505fed897a7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.544496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.545213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.545560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.545896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.547118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.548785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.578188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1159/2335] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:40.582453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.612842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.615014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.616164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8c256-b75a-4f9c-b924-4f4202bb28d8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.637552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.638176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.638284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2b7eb-6bf3-4a7d-919e-cd44166c48a4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.638453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.638722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.639439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.641127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.653692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.654344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.654699 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.654974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] PATH_INFO: `/v3/projects/94900a32f8034efca826eda4a232aa62` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.656262 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1177/2336] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:40.656926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94900a32f8034efca826eda4a232aa62)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.657370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.661877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.669645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5c07-1b4e-4a07-a8ec-28352a189730 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.680405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.681176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.681973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.682532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.683966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.688246 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.700556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1178/2337] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:40.704588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:40.712169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:40.719014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc143033-ab89-44ba-8021-eb584aa7261b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:40.742552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:40.743230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.743568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.744612 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] PATH_INFO: `/v3/projects/cada99ffd2f24ac795a03480120bcbfa/users/8ed85d941d2c42ea845ea7d57d54e8c0/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.772755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cada99ffd2f24ac795a03480120bcbfa, user_id=8ed85d941d2c42ea845ea7d57d54e8c0, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:40.776598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd5247d-4f31-486b-ab98-2105be5981e5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:40.811420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94900a32f8034efca826eda4a232aa62', 'request_id': 'req-d4e860aa-67e9-48c9-a7a9-156fcd483e14'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.818788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1179/2338] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:40 2022] PUT /identity/v3/projects/cada99ffd2f24ac795a03480120bcbfa/users/8ed85d941d2c42ea845ea7d57d54e8c0/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:40.820358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.820654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.820919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.846435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94900a32f8034efca826eda4a232aa62', 'request_id': 'req-d4e860aa-67e9-48c9-a7a9-156fcd483e14'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.877520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94900a32f8034efca826eda4a232aa62', 'request_id': 'req-d4e860aa-67e9-48c9-a7a9-156fcd483e14'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.905854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] The token cache is being invalidate because project 94900a32f8034efca826eda4a232aa62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:40.906151 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.911559 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-d4e860aa-67e9-48c9-a7a9-156fcd483e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:40.914111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1160/2339] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:40 2022] DELETE /identity/v3/projects/94900a32f8034efca826eda4a232aa62 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:40.916369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] MFA Rules not processed for user `8ed85d941d2c42ea845ea7d57d54e8c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:40.916369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:40.920654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e211-f3ec-4f67-8a99-07e8fe9b3759 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:40.921149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e211-f3ec-4f67-8a99-07e8fe9b3759 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:40.921422 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258e211-f3ec-4f67-8a99-07e8fe9b3759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:40.984780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4258e211-f3ec-4f67-8a99-07e8fe9b3759 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:40.986237 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4258e211-f3ec-4f67-8a99-07e8fe9b3759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.022344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.063256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1180/2340] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:41.070869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.072687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.087360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1161/2341] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:41.089712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.090577 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.090938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.092263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb1ecb-00ea-46fe-aac5-795387fbb8b9 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.097172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.098011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.098428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.098858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.099675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.102180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.136117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:41.148634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1181/2342] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:41.150451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.156696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.267248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1162/2343] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:41.271305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.281557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3c1309-89cc-482a-88ce-7b1ff3da8d8b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.287876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.288930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.289475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.289806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c0561-b2e3-4c05-bf4a-bc830c63b518 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.290186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.291841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:41.292682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.295344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.308163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.308800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.309081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.309368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.310123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.312445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.318878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1163/2344] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:41.326400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.340454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36081e-a991-40ac-90a3-0e3ed507c788 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.350796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.351844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.355523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1182/2345] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:41.356099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.356646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.361266 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.363011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.365945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.367743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835ca3-6118-42cf-aa5a-8a49d709bc3a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.373943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.374691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.374969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.375351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.376053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.377715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.389616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1183/2346] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:41.393931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.403635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1164/2347] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/projects => generated 399 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:41.405940 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951b69a-01c8-475c-9606-f2064ad2b456 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.406523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.430465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.479757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.480353 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.480655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.481079 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] PATH_INFO: `/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa/users/40f556e4743d4a8dbf8fd373c9d2841f/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.490281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc277453-beed-4909-861d-024e6cdbe5e4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.495768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.496522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.496903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.497283 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.498016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.500133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.501748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5808d4b957f4e5a879fae3e4d5f62fa, user_id=40f556e4743d4a8dbf8fd373c9d2841f, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.505151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.523517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1184/2348] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:41 2022] PUT /identity/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa/users/40f556e4743d4a8dbf8fd373c9d2841f/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:41.529569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1165/2349] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:41.529740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.531267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.542297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0306e5-5807-4014-836b-bfb957526225 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.565018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:41.605324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e405d-e1b8-416c-8914-617181411349 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.610339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.610958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.611239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.611542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.612206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.613854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.625853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1185/2350] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:41.630418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.637565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.638443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.638693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.638973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.639662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.641970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.644812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d610b3-308c-4c87-a4b7-3e7092409c1a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.650564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.651446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.651900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.652202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] PATH_INFO: `/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa/users/40f556e4743d4a8dbf8fd373c9d2841f/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.654324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1166/2351] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:41.659525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5808d4b957f4e5a879fae3e4d5f62fa, user_id=40f556e4743d4a8dbf8fd373c9d2841f, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.659661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.660865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9251f5b-a979-4daa-818c-fa9f4302dab3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.671239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e454014-2019-4419-b188-ae04923c1ea0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.683507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1186/2352] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:41 2022] PUT /identity/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa/users/40f556e4743d4a8dbf8fd373c9d2841f/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:41.687226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.690676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.690999 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.735173 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] MFA Rules not processed for user `40f556e4743d4a8dbf8fd373c9d2841f`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:41.737248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.767837 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.768800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.769250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.769529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.770207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.771825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.783267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1167/2353] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:41.788810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.805532 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aebe92f-9114-4a9d-8a21-0438f3a9e04e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:41.813196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:41.814158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.814536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.814996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] PATH_INFO: `/v3/projects/b4259692ce1e4d5491aac44e88422f09/users/e7066c37d7344daba17fcd9048c8c439/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.836807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4259692ce1e4d5491aac44e88422f09, user_id=e7066c37d7344daba17fcd9048c8c439, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:41.841069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8509ca6-baa7-4dab-ac42-a21275f29749 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:41.861100 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1168/2354] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:41 2022] PUT /identity/v3/projects/b4259692ce1e4d5491aac44e88422f09/users/e7066c37d7344daba17fcd9048c8c439/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:41.877734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:41.878114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:41.878463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:41.880715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1187/2355] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:41.898920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:41.901738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.930295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] MFA Rules not processed for user `e7066c37d7344daba17fcd9048c8c439`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:41.932407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:41.933359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:42.002429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dd1a4-3afc-480f-8f7c-c9e84d490b5b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.065018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1169/2356] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:41 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:55:42.072530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:42.075528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:42.091183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.091981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.095208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.095208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.125171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:42.207569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.209208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.221529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d063b1-1e9d-456a-8c51-b82e5d4fbeb1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:42.226117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:42.226866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:42.227174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:42.227659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:42.236772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1188/2357] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:42.249215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:42.254844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeec542-9f42-43d4-a5c9-d7fddb9a262a service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:42.278558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1170/2358] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:45.194767 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:45.264974 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d57600-5450-428b-84f6-1b4d3ec79451 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:45.270044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:45.270696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:45.270958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:45.271225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] PATH_INFO: `/v3/users/8ed85d941d2c42ea845ea7d57d54e8c0` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:45.272569 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ed85d941d2c42ea845ea7d57d54e8c0)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:45.274499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:45.311795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:45.354327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ed85d941d2c42ea845ea7d57d54e8c0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:45.355260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ed85d941d2c42ea845ea7d57d54e8c0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:45.356068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ed85d941d2c42ea845ea7d57d54e8c0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:45.364883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ed85d941d2c42ea845ea7d57d54e8c0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:45.375963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ed85d941d2c42ea845ea7d57d54e8c0'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:45.402718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1189/2359] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:45 2022] DELETE /identity/v3/users/8ed85d941d2c42ea845ea7d57d54e8c0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:45.406950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:45.407525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:45.407525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:45.434750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:45.434750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:45.515011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1171/2360] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:45.526779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:45.528423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:45.586565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0e44d-f8ca-4ed1-8e05-784849615fe2 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:45.590848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:45.591448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:45.591760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:45.592031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:45.601474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:45.603690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:45.614011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1190/2361] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:46.006924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.008476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.022650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b4a0e-0e07-40de-b4f8-333a4873f9aa None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.029780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.030487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.030831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.031364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] PATH_INFO: `/v3/projects/cada99ffd2f24ac795a03480120bcbfa` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.032996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cada99ffd2f24ac795a03480120bcbfa)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.035563 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.143858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cada99ffd2f24ac795a03480120bcbfa', 'request_id': 'req-cd222af7-50d6-48e5-a9ce-33bb32a181e7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.151522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cada99ffd2f24ac795a03480120bcbfa', 'request_id': 'req-cd222af7-50d6-48e5-a9ce-33bb32a181e7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.157438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cada99ffd2f24ac795a03480120bcbfa', 'request_id': 'req-cd222af7-50d6-48e5-a9ce-33bb32a181e7'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.174604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] The token cache is being invalidate because project cada99ffd2f24ac795a03480120bcbfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:46.175006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.175801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.180452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1172/2362] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:46 2022] DELETE /identity/v3/projects/cada99ffd2f24ac795a03480120bcbfa => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:46.182466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.193884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe98c9-c330-4f94-9a17-34abf6041908 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.273774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.274534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.275344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.275344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] PATH_INFO: `/v3/users/40f556e4743d4a8dbf8fd373c9d2841f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.276739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f556e4743d4a8dbf8fd373c9d2841f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.278898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.333706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f556e4743d4a8dbf8fd373c9d2841f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.334449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f556e4743d4a8dbf8fd373c9d2841f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.335133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f556e4743d4a8dbf8fd373c9d2841f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.338479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:46.347060 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f556e4743d4a8dbf8fd373c9d2841f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.355672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-dfc50dfd-214d-4a81-a858-918171c9c5c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f556e4743d4a8dbf8fd373c9d2841f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.376844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1191/2363] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:46 2022] DELETE /identity/v3/users/40f556e4743d4a8dbf8fd373c9d2841f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:46.724729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:46.726258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:46.740624 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd222af7-50d6-48e5-a9ce-33bb32a181e7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:46.804227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:46.826239 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:46.827156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.827680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.827992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] PATH_INFO: `/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.829928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5808d4b957f4e5a879fae3e4d5f62fa)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:46.832919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:46.899186 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5808d4b957f4e5a879fae3e4d5f62fa', 'request_id': 'req-1c46b870-85ed-40a1-b785-0695fd7a52f5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.908262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5808d4b957f4e5a879fae3e4d5f62fa', 'request_id': 'req-1c46b870-85ed-40a1-b785-0695fd7a52f5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.913941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5808d4b957f4e5a879fae3e4d5f62fa', 'request_id': 'req-1c46b870-85ed-40a1-b785-0695fd7a52f5'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.933154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] The token cache is being invalidate because project d5808d4b957f4e5a879fae3e4d5f62fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:46.933449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.934130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1c46b870-85ed-40a1-b785-0695fd7a52f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:46.935870 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1173/2364] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:46 2022] DELETE /identity/v3/projects/d5808d4b957f4e5a879fae3e4d5f62fa => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:46.942398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:46.942398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:46.942717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:46.964048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:46.965387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.039094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1192/2365] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:47.047878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.048385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.048735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.071214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:47.073322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.081676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1174/2366] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:47.086008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.095827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6df98-19ec-4f85-b5d0-bb8baacaf4af None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.100464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.101063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.101343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.101613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.102260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:47.102566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.104222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.122684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1193/2367] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:47.123408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.135454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5a5d4-3896-43e0-a5b7-36c6cb30b332 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.142226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.143292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.143841 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.144347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.145196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.147426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.229537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1175/2368] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:47.233586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.245852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c800f-0d16-47db-8be7-9bfbc3ebd427 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.338693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.339453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.339675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.339953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.340651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.343764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.372929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1194/2369] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:47.377290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.390011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fa9084-ce1d-4777-8273-ffbb58483b82 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.401038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.401672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.401949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.402271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.402940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.405543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.427263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.427666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1176/2370] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:47.438239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa830c2-d822-416d-bdef-0b4c16e2ec47 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.443707 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.444518 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.444898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.445097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.445849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.449386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6717c98-08e7-4327-82d1-c252baef1020 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.472687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1195/2371] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:47.473924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.494760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc7ac8-4a3c-4db5-8727-9ced5e448a0f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.500637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.501449 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.501793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.502136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] PATH_INFO: `/v3/projects/1cfb018bc58740499adebd6bd2df8442/users/31fc31a3d9fc4e8e9d09ac755701a178/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.520613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfb018bc58740499adebd6bd2df8442, user_id=31fc31a3d9fc4e8e9d09ac755701a178, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.523997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.549499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1177/2372] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:47 2022] PUT /identity/v3/projects/1cfb018bc58740499adebd6bd2df8442/users/31fc31a3d9fc4e8e9d09ac755701a178/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:47.560944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd625-8136-4768-9801-8682e619b794 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.561225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd625-8136-4768-9801-8682e619b794 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.561580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efd625-8136-4768-9801-8682e619b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.596086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-04efd625-8136-4768-9801-8682e619b794 None None] MFA Rules not processed for user `31fc31a3d9fc4e8e9d09ac755701a178`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:47.597834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-04efd625-8136-4768-9801-8682e619b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.620517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:47.674599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1196/2373] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:47.688184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.690128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.701785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efd625-8136-4768-9801-8682e619b794 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:47.703341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-04efd625-8136-4768-9801-8682e619b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.764519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aed63d-e21b-497a-817d-8d8e54434a5d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.769753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.770375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.770654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.770926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.784253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.786065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48fb7d-9da4-4065-8c17-8c62596906dc service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.794743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efd625-8136-4768-9801-8682e619b794 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:47.800212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1178/2374] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:47.800411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:47.801050 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.801413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.801703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] PATH_INFO: `/v3/users/e7066c37d7344daba17fcd9048c8c439` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.802856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7066c37d7344daba17fcd9048c8c439)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:47.804989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:47.866864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7066c37d7344daba17fcd9048c8c439'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:47.867713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7066c37d7344daba17fcd9048c8c439'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:47.868435 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7066c37d7344daba17fcd9048c8c439'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:47.875757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7066c37d7344daba17fcd9048c8c439'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:47.887643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7066c37d7344daba17fcd9048c8c439'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:47.908142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1197/2375] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:47 2022] DELETE /identity/v3/users/e7066c37d7344daba17fcd9048c8c439 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:47.912538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:47.912838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:47.913129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:47.934356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:47.935737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:47.946284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:48.026400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1179/2376] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:48.036487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:48.038021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.117108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:48.131275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621da841-38e2-4bda-b789-9c69925f3d1e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:48.140391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:48.141027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.141476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.142255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.179958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:48.182124 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cae6a-9684-4ae3-9656-fc6ce2326e93 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:48.200375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1198/2377] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:48.652657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:48.659416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.675169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a42b3-5335-44c5-90b3-f747138976ab None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:48.681492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:48.682169 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.682458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.682726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] PATH_INFO: `/v3/projects/b4259692ce1e4d5491aac44e88422f09` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.683896 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4259692ce1e4d5491aac44e88422f09)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:48.685867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:48.749983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4259692ce1e4d5491aac44e88422f09', 'request_id': 'req-f608daf3-aeae-4c1d-8a83-ee59f4297abd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:48.762032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4259692ce1e4d5491aac44e88422f09', 'request_id': 'req-f608daf3-aeae-4c1d-8a83-ee59f4297abd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:48.769051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4259692ce1e4d5491aac44e88422f09', 'request_id': 'req-f608daf3-aeae-4c1d-8a83-ee59f4297abd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:48.808573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] The token cache is being invalidate because project b4259692ce1e4d5491aac44e88422f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:48.808892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:48.809749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f608daf3-aeae-4c1d-8a83-ee59f4297abd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:48.812487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1180/2378] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:48 2022] DELETE /identity/v3/projects/b4259692ce1e4d5491aac44e88422f09 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:48.817280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.817786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.817868 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.838742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:48.840054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.914273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1199/2379] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:48.924256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.924630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.924980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.946325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:48.948415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:48.956565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1181/2380] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:48.960802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:48.971559 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8119a3-ee91-497c-8820-283f6846ba3b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:48.976231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:48.976864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:48.977144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:48.977414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:48.978116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:48.978479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:48.980282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:48.992495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1200/2381] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 04:55:48.997043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.006818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da33b9-e111-4feb-a0bb-aa5fcccbff5c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.012504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.013204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.013573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.013907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.014598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.016617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.048094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1182/2382] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:48 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:49.052239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.062466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95aa1a0-1db5-4e38-a1c8-dad10d227885 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.127283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.127952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.128230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.128500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.129172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.131148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.164556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1201/2383] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:49 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:49.169653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.180365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc591b-7ef7-46bb-bbed-eba96afa09dd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.185403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.186010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.186285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.187230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.187910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.189615 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.205384 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1183/2384] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:49.206678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.217973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226d26c-9ba2-4fa0-b4df-57d8e14f2030 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.223656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.224365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.224712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.228354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.229235 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.231063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86654a81-c757-433d-b7b4-43113d562f5e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.246872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1202/2385] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:49.251182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.262310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688079e-c7b0-4af0-b2cd-73c109ecb5c3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.267623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.268290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.268564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.268834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] PATH_INFO: `/v3/projects/4d7c13a5d23c4422899c5e2c7eb650f5/users/7432fd6923ca4343b82b1368156bec23/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.285821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7c13a5d23c4422899c5e2c7eb650f5, user_id=7432fd6923ca4343b82b1368156bec23, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.292523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.319932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1184/2386] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:49 2022] PUT /identity/v3/projects/4d7c13a5d23c4422899c5e2c7eb650f5/users/7432fd6923ca4343b82b1368156bec23/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:49.325149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.325429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.325701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.345194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:49.346408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.406117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:49.422066 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1203/2387] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:49.438702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:49.440836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:49.515097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:49.536976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cb34-2140-4854-9ba9-817325f9ffd6 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:49.540945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:49.541641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:49.541923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:49.542197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:49.552817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:49.554334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b27eda-0fdc-4e99-83da-a7f212de444e service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:49.569669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1185/2388] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:51.348141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:51.350602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:51.365917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63815f-66c8-4587-b1b8-35531b7c9ee2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:51.371089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:51.372146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:51.372146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:51.372377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] PATH_INFO: `/v3/users/31fc31a3d9fc4e8e9d09ac755701a178` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:51.373656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31fc31a3d9fc4e8e9d09ac755701a178)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:51.376688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:51.471976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31fc31a3d9fc4e8e9d09ac755701a178'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:51.473396 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31fc31a3d9fc4e8e9d09ac755701a178'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:51.474739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31fc31a3d9fc4e8e9d09ac755701a178'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:51.498190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31fc31a3d9fc4e8e9d09ac755701a178'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:51.518717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31fc31a3d9fc4e8e9d09ac755701a178'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:51.575373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:51.576019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:51.576019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:51.579507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1204/2389] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:55:51 2022] DELETE /identity/v3/users/31fc31a3d9fc4e8e9d09ac755701a178 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:51.609088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:51.610814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:51.702795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1186/2390] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:51.714102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:51.715677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:51.807179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266199ba-e8e5-4d41-9b7a-0c745a46e43b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:51.812016 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:51.819679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:51.820096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:51.820380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:51.831507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:51.832977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d955-b24d-483e-b6be-bb7470b4571f service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:51.844164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1205/2391] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:55:52.378015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:52.380123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:52.393364 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25c32-fbfc-4884-984f-08d7bec1f4a5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:52.401069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:52.401923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.402298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.402671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] PATH_INFO: `/v3/projects/1cfb018bc58740499adebd6bd2df8442` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.404061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfb018bc58740499adebd6bd2df8442)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:52.406297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:52.484099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfb018bc58740499adebd6bd2df8442', 'request_id': 'req-7bf3fcfa-95d4-4c7b-9924-797d9daab868'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:52.493685 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfb018bc58740499adebd6bd2df8442', 'request_id': 'req-7bf3fcfa-95d4-4c7b-9924-797d9daab868'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:52.501323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfb018bc58740499adebd6bd2df8442', 'request_id': 'req-7bf3fcfa-95d4-4c7b-9924-797d9daab868'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:52.517125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] The token cache is being invalidate because project 1cfb018bc58740499adebd6bd2df8442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:55:52.517514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:52.518527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7bf3fcfa-95d4-4c7b-9924-797d9daab868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:55:52.520592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1187/2392] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:55:52 2022] DELETE /identity/v3/projects/1cfb018bc58740499adebd6bd2df8442 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:52.525857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.526356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.527088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.549531 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:52.550908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:52.647516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1206/2393] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:52.714493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.715041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.715041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.744456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:52.745267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:52.763867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1188/2394] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:52.767718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:52.783708 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1557de-e9af-4105-ad5c-2acefa259035 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:52.789356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:52.790688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.791093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.791372 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.792203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:55:52.792516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:52.794368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:52.796405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:52.810887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1207/2395] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:55:52.814888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:52.825250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d4b89-e4a3-4626-952b-98e6a79739e2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:52.831609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:52.831853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.832132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.832406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.832907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:52.835529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:52.868828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1189/2396] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:52 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 04:55:52.872845 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:52.884474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65d985-fcdd-4f9d-99df-99040bae1692 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:52.955863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:52.957274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:52.957706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:52.958146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:52.958935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:52.961398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:52.993779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1208/2397] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:52 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:52.998415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:53.010966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481813f-54b8-4091-88f2-82d5cf554d5d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:53.017387 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:53.018001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.018493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.018773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.020293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:53.021796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:53.035662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1190/2398] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:55:53.039416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:53.054812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20503eb9-54e8-4a22-a0b2-d34ffe671c69 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:53.061043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:53.061837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.062125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.062402 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.063438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:53.065540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8774d286-335a-46da-a897-8166213e74a8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:53.083666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1209/2399] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:53.088020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:53.100655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b027b89f-4c37-4b77-a214-12a232cecaf3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:53.106689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:53.107414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.107728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.108004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] PATH_INFO: `/v3/projects/968a28473d44444989f18ea338da2bce/users/21bd3dde792a4a49b7d67fadfc684d5f/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.132070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=968a28473d44444989f18ea338da2bce, user_id=21bd3dde792a4a49b7d67fadfc684d5f, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:53.135926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:53.149070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:53.156929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1191/2400] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:53 2022] PUT /identity/v3/projects/968a28473d44444989f18ea338da2bce/users/21bd3dde792a4a49b7d67fadfc684d5f/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:55:53.167898 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221599b-74ba-4feb-821b-faee90c400aa None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.168444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221599b-74ba-4feb-821b-faee90c400aa None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.168718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221599b-74ba-4feb-821b-faee90c400aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.217674 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5221599b-74ba-4feb-821b-faee90c400aa None None] MFA Rules not processed for user `21bd3dde792a4a49b7d67fadfc684d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:53.219418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5221599b-74ba-4feb-821b-faee90c400aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:53.309979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1210/2401] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:53.323458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:53.325933 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:53.396774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bda9d8-8413-4f94-9996-1d9bd83a6f3a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:53.401840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:53.402517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:53.402800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:53.403077 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:53.413897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:53.416750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed502c5-462f-419d-8660-4a3c8ea16b26 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:53.428742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1192/2402] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:55:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:55:54.894247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:54.894730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:54.894822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:54.920966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] MFA Rules not processed for user `21bd3dde792a4a49b7d67fadfc684d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:54.922449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:54.938476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1211/2403] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:55.562527 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:55.563042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:55.563128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:55.624879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] MFA Rules not processed for user `7432fd6923ca4343b82b1368156bec23`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:55:55.627306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:55.721557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1193/2404] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:55:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:55:55.727906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:55.730517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:55:55.823013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:55.830466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42ba75-9f30-4e96-9fbe-53490e9ec455 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:55.836223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:55.837422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:55.837813 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:55.838227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:55.838856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:55.840793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:55.874642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1212/2405] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:55.878347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:55.890006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300c032-3d54-4dab-8490-8da0212139f4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:55.958657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:55.959501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:55.959835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:55.960109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:55.960940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:55.965056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:56.004882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1194/2406] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:55:55 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:55:56.006296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:56.020185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e559e4-6bb7-480e-8419-cad871485e9e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:56.026209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:56.027284 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:56.027780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:56.028047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:56.028914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:56.030815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:56.049313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:56.049903 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1213/2407] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:56.061863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e373a94-951f-4aa1-a065-3b4778c0987d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:56.068376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:56.069793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:56.070214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:56.070670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] PATH_INFO: `/v3/projects/304d11ee08c64b2587b85d4de4207cd2/users/1346f58da17e42658ec8086ae57a143f/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:56.091495 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=304d11ee08c64b2587b85d4de4207cd2, user_id=1346f58da17e42658ec8086ae57a143f, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:56.096936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:56.101355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:55:56.137846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:56.138726 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1195/2408] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:56 2022] PUT /identity/v3/projects/304d11ee08c64b2587b85d4de4207cd2/users/1346f58da17e42658ec8086ae57a143f/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:55:56.152751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce0466-81ff-4cff-be8d-33c55f52a1aa admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:56.268256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:56.269142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:56.269578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:56.270004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:56.270958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:56.273010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a708c-152f-4277-a00b-68ca9c47cd96 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:56.292713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1214/2409] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:55:56.297279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:55:56.309154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d8969-fba0-4d9a-b1ac-b062c365c29e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:55:56.316004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:55:56.316924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:55:56.317207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:55:56.317479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] PATH_INFO: `/v3/projects/304d11ee08c64b2587b85d4de4207cd2/users/1346f58da17e42658ec8086ae57a143f/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:55:56.319459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=304d11ee08c64b2587b85d4de4207cd2, user_id=1346f58da17e42658ec8086ae57a143f, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:55:56.322357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:55:56.337965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1196/2410] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:55:56 2022] PUT /identity/v3/projects/304d11ee08c64b2587b85d4de4207cd2/users/1346f58da17e42658ec8086ae57a143f/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:03.574311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654a10-1cc3-4498-8cee-f1663bea135b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:03.574795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654a10-1cc3-4498-8cee-f1663bea135b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:03.575017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654a10-1cc3-4498-8cee-f1663bea135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:03.651978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8e654a10-1cc3-4498-8cee-f1663bea135b None None] MFA Rules not processed for user `1346f58da17e42658ec8086ae57a143f`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:03.653969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8e654a10-1cc3-4498-8cee-f1663bea135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:03.836943 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1215/2411] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:03.865575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:03.868174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:03.992175 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1883c-7766-4237-9b15-ec8cc66bc865 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:03.997765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:03.998367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:03.999329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:03.999649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:04.079689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:04.081423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43d3bd-307c-44cc-9ab0-5d28d577c4f6 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:04.092703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1197/2412] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:06.271309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368274-91c3-4c58-ae2b-b9aeb75af039 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:06.272196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368274-91c3-4c58-ae2b-b9aeb75af039 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:06.272701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72368274-91c3-4c58-ae2b-b9aeb75af039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:06.299771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-72368274-91c3-4c58-ae2b-b9aeb75af039 None None] MFA Rules not processed for user `7432fd6923ca4343b82b1368156bec23`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:06.302062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-72368274-91c3-4c58-ae2b-b9aeb75af039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:06.312488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1216/2413] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:10.901755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a554-5137-40c7-867e-718a95a50073 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:10.902303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a554-5137-40c7-867e-718a95a50073 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:10.902673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22a554-5137-40c7-867e-718a95a50073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:10.923926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4d22a554-5137-40c7-867e-718a95a50073 None None] MFA Rules not processed for user `3471f2d8c7e9409b8ca57fb60ce876e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:10.926122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4d22a554-5137-40c7-867e-718a95a50073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:10.992856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1198/2414] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:16.296183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=79,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:17.269921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:17.270507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:17.270939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:17.301824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] MFA Rules not processed for user `e87c835bd666445a826bd7e7871023c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:17.306954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:17.383835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1217/2415] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:20.981660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:23.864296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:23.864902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:23.864902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:23.888245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:23.889456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:23.948924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1199/2416] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:56:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:23.969643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:23.971062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:23.971829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:23.973173 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:24.033040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ef8d5-36d7-4013-8aa3-977589fae8c4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:24.036796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:24.037404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:24.037677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:24.037942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:24.039880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:24.050491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1e54f-5a4a-4132-8ffb-984070fa1c8b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:24.056636 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:24.057261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:24.057539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:24.057811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:24.066372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:24.067941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ea0e5-e2ec-4e1d-a5b4-0f090e2c3bc5 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:24.076638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1200/2417] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 04:56:24.107769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:24.109251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:24.120389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1218/2418] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:23 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:24.608921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5c02-db13-43f9-b47e-20b304a9d2ca None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:24.609316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5c02-db13-43f9-b47e-20b304a9d2ca None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:24.609611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f5c02-db13-43f9-b47e-20b304a9d2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:24.634276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-da3f5c02-db13-43f9-b47e-20b304a9d2ca None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:24.635717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-da3f5c02-db13-43f9-b47e-20b304a9d2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:24.646067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1201/2419] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 04:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:24.659820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:24.671411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d6f8f-f7e4-4077-8ac2-4269c41c8bcb service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:24.676527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:24.677133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:24.677409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:24.677680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:24.687365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:24.689002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:24.698006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1219/2420] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:24.973018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148daf58-dc22-4a67-93c1-9ee11d7273dd None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:24.973490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148daf58-dc22-4a67-93c1-9ee11d7273dd None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:24.973599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148daf58-dc22-4a67-93c1-9ee11d7273dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:24.997146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-148daf58-dc22-4a67-93c1-9ee11d7273dd None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:24.998377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-148daf58-dc22-4a67-93c1-9ee11d7273dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:25.006813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1202/2421] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:56:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:25.025118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:25.035906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ba893-ec46-4173-b5a0-c179f951fb31 service swift] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:25.041867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:25.042747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:25.043006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:25.043277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:25.051436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:25.053019 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:25.061339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1220/2422] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:25.394485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:25.394844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:25.395204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:25.417114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:25.418609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:25.425761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1203/2423] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 04:56:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:25.438530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:25.450715 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a426f62-f85d-4885-b806-386f510def93 service swift] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:25.461794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:25.462521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:25.462894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:25.463257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:25.472301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:25.473939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fcc96-d85a-492f-8e2e-eac24e8d6e93 service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:25.483277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1221/2424] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:27.878083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:27.954976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac2792-89a1-4a10-b029-4ad68b4e1139 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:27.961653 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:27.962348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:27.962628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:27.962902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] PATH_INFO: `/v3/users/21bd3dde792a4a49b7d67fadfc684d5f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:27.964074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21bd3dde792a4a49b7d67fadfc684d5f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:27.966677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:27.991745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:28.039301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21bd3dde792a4a49b7d67fadfc684d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:28.040286 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21bd3dde792a4a49b7d67fadfc684d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:28.050359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21bd3dde792a4a49b7d67fadfc684d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:28.051418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21bd3dde792a4a49b7d67fadfc684d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:28.061557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21bd3dde792a4a49b7d67fadfc684d5f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:28.096817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1204/2425] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:56:27 2022] DELETE /identity/v3/users/21bd3dde792a4a49b7d67fadfc684d5f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:28.098488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:28.098947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:28.099061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:28.131057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:28.132817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:28.148534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:28.216278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1222/2426] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:28.225771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:28.227710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:28.358230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b009b2-9c1f-4545-85c1-a1f00c3e1f51 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:28.363538 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:28.364544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:28.365032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:28.365640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:28.377312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:28.379075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:28.392212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1205/2427] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:29.022763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:29.024381 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:29.036534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441622c-ddd6-4b2d-b2cc-3f28d49a772b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:29.046264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:29.047457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:29.047980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:29.048593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] PATH_INFO: `/v3/projects/968a28473d44444989f18ea338da2bce` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:29.051117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968a28473d44444989f18ea338da2bce)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:29.053449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:29.122323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968a28473d44444989f18ea338da2bce', 'request_id': 'req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:29.129931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968a28473d44444989f18ea338da2bce', 'request_id': 'req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:29.140735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968a28473d44444989f18ea338da2bce', 'request_id': 'req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:29.155603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] The token cache is being invalidate because project 968a28473d44444989f18ea338da2bce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:56:29.155900 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:29.156575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c4f93bd6-a3fe-4f03-a6cb-11f7804c3127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:56:29.158287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1223/2428] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:56:29 2022] DELETE /identity/v3/projects/968a28473d44444989f18ea338da2bce => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:56:38.386531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=9,keystone:SELECT=46,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:39.152414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:50.021134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:50.024094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:50.035372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e75c-cfee-466e-afba-137a252dcd2e service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:50.086558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:50.087167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:50.087499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:50.087768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:50.089499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:50.152041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:50.153467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:50.163851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1206/2429] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:56:51.019260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715878e1-d480-4752-88ab-b4719b824061 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:51.019785 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715878e1-d480-4752-88ab-b4719b824061 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:51.019865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715878e1-d480-4752-88ab-b4719b824061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:51.041355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-715878e1-d480-4752-88ab-b4719b824061 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:51.042822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-715878e1-d480-4752-88ab-b4719b824061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:51.103442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1224/2430] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 04:56:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:51.118468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:51.120009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:51.200087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04777dcc-59d1-4e98-98a1-6c47ab71eeea service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:51.205894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:51.206503 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:51.206838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:51.207118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:51.216376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:51.218042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:51.226656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1207/2431] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:56:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:56:54.967177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297746a-1763-4865-8b35-b7584b4998a8 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:54.967764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297746a-1763-4865-8b35-b7584b4998a8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:54.967764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297746a-1763-4865-8b35-b7584b4998a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:54.997455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f297746a-1763-4865-8b35-b7584b4998a8 None None] MFA Rules not processed for user `5eadf34dc91e4dd79d00a9e218117032`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:56:54.998695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f297746a-1763-4865-8b35-b7584b4998a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:55.064989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1225/2432] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:56:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:56:56.551127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:56:56.553264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:56.608109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:56:56.638795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b12a4-3e7b-4307-aed5-3046ac3948df service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:56:56.645625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:56:56.646556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:56:56.647035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:56:56.647622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:56:56.650044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:56:56.666024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:56:56.668074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:56:56.682971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1208/2433] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:56:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:05.055540 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=50 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:06.674424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=14 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:07.479962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:07.480449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:07.480549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:07.501058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:07.502258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:07.509830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1226/2434] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 04:57:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:07.523509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:07.534650 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dafe1e-a09b-415f-bde7-78b9ae3392d2 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:07.540240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:07.540833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:07.541113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:07.541393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:07.550201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:07.551817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:07.560478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1209/2435] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:57:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:57:09.560835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:09.562379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:09.629990 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce0446-deef-48c8-b9c5-a2e89c76f261 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:09.634595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:09.635230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:09.635542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:09.635822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] PATH_INFO: `/v3/users/3471f2d8c7e9409b8ca57fb60ce876e4` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:09.636982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3471f2d8c7e9409b8ca57fb60ce876e4)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:09.638919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:09.687440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3471f2d8c7e9409b8ca57fb60ce876e4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:09.688140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3471f2d8c7e9409b8ca57fb60ce876e4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:09.688740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3471f2d8c7e9409b8ca57fb60ce876e4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:09.695771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3471f2d8c7e9409b8ca57fb60ce876e4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:09.703120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cf04d46f-b993-493d-81a7-9fc645d93df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3471f2d8c7e9409b8ca57fb60ce876e4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:09.719966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1227/2436] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:57:09 2022] DELETE /identity/v3/users/3471f2d8c7e9409b8ca57fb60ce876e4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:09.928567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:09.941691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2ecb0-3c2c-4315-8a77-048129b3cc28 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.028771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.029425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.029768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.030046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] PATH_INFO: `/v3/projects/f9918f92fc9f46d18883a0d6335744a0` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.031170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9918f92fc9f46d18883a0d6335744a0)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.033170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.079771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9918f92fc9f46d18883a0d6335744a0', 'request_id': 'req-6984787c-63fa-4a4e-8e39-35bf27632a43'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:10.086330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9918f92fc9f46d18883a0d6335744a0', 'request_id': 'req-6984787c-63fa-4a4e-8e39-35bf27632a43'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:10.091823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9918f92fc9f46d18883a0d6335744a0', 'request_id': 'req-6984787c-63fa-4a4e-8e39-35bf27632a43'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:10.104316 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] The token cache is being invalidate because project f9918f92fc9f46d18883a0d6335744a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:57:10.104662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:10.105282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6984787c-63fa-4a4e-8e39-35bf27632a43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:10.106863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1210/2437] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:57:09 2022] DELETE /identity/v3/projects/f9918f92fc9f46d18883a0d6335744a0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:10.111752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.112044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.112321 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.133275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:10.134510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:10.196323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1228/2438] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:10.204343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.204716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.205054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.245703 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:10.246970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:10.255066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1211/2439] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 04:57:10.259456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.268985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441dd0d-e76e-4f38-bf4f-25330a6b2069 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.273762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.274361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.274636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.274902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.275570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 04:57:10.275866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.277449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.286857 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:10.290503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1229/2440] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 04:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 04:57:10.295776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.306446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c771d5-de6f-4dbf-a4dd-16b9bed3c817 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.311130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.311772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.312336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.312616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.313378 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.315270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.344098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1212/2441] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 04:57:10 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:57:10.354047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.365364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000c4719-2c22-42f4-a18c-8d910457f540 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.425123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.426330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.426330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.426330 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.427457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.429641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.455737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1230/2442] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 04:57:10 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 04:57:10.456853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.468463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ebc63-13d4-47b1-913f-be6b305c98e7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.474174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.474898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.475185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.475462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.476152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.477745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.489719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1213/2443] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 04:57:10.494283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.510778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4d97b-3016-4e7b-9a37-36f9c25df023 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.515970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.516576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.516859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.517133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.517802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.521053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02687a-022a-4920-a816-06fd1789265d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.532365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1231/2444] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 04:57:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 04:57:10.537523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.548126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56d857-55d4-4d0f-9f45-11d134472863 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.552881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.553554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.553835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.554109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] PATH_INFO: `/v3/projects/6a56b2fe5382447db512bb8845c725fa/users/07c0d92f3b154670ad7f9d71c70607b5/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.568786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a56b2fe5382447db512bb8845c725fa, user_id=07c0d92f3b154670ad7f9d71c70607b5, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.571418 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.585583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1214/2445] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 04:57:10 2022] PUT /identity/v3/projects/6a56b2fe5382447db512bb8845c725fa/users/07c0d92f3b154670ad7f9d71c70607b5/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:57:10.595949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.596442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.596627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.626599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] MFA Rules not processed for user `07c0d92f3b154670ad7f9d71c70607b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:10.627892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:10.695513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1232/2446] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:57:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:10.707065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:10.709354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:10.724865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:10.772210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88874d74-bf6d-4666-b7df-a2153c15558d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:10.775799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:10.776425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:10.776741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:10.777067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:10.785488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:10.787718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389ab0a-8de8-4073-a891-0e2da19e95e3 service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:10.798671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1215/2447] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:10 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:20.692298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:20.794583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=20 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:45.169160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:45.231171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a952c6a-36e8-4600-885c-70a5a80b472b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:45.235839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:45.236400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:45.236681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:45.236953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] PATH_INFO: `/v3/users/07c0d92f3b154670ad7f9d71c70607b5` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:45.238074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c0d92f3b154670ad7f9d71c70607b5)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:45.240024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:45.288319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c0d92f3b154670ad7f9d71c70607b5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.288986 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c0d92f3b154670ad7f9d71c70607b5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.289601 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c0d92f3b154670ad7f9d71c70607b5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.296910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c0d92f3b154670ad7f9d71c70607b5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.304257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c0d92f3b154670ad7f9d71c70607b5'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.321264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1233/2448] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:57:45 2022] DELETE /identity/v3/users/07c0d92f3b154670ad7f9d71c70607b5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:45.326261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:45.326736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:45.326840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:45.346014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:57:45.347224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:45.406972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1216/2449] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:57:45.416927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:45.418370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:45.476457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45296e92-129b-4bb1-92da-a5d215df43b3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:45.480263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:45.480866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:45.481320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:45.481453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:45.490627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:45.492112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:45.501817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1234/2450] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:57:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:57:45.764065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:57:45.765733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:57:45.778356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6456b-1e27-4779-9e62-a8f9136d4f86 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:57:45.783224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:57:45.783949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:57:45.784233 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:57:45.784509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] PATH_INFO: `/v3/projects/6a56b2fe5382447db512bb8845c725fa` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:57:45.785663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a56b2fe5382447db512bb8845c725fa)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:57:45.787628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:57:45.835716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a56b2fe5382447db512bb8845c725fa', 'request_id': 'req-f701314e-ffda-4e3e-aecb-597ba691bbe1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.841921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a56b2fe5382447db512bb8845c725fa', 'request_id': 'req-f701314e-ffda-4e3e-aecb-597ba691bbe1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.847633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a56b2fe5382447db512bb8845c725fa', 'request_id': 'req-f701314e-ffda-4e3e-aecb-597ba691bbe1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.860102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] The token cache is being invalidate because project 6a56b2fe5382447db512bb8845c725fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:57:45.860390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.861018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:57:45.862510 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1217/2451] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:57:45 2022] DELETE /identity/v3/projects/6a56b2fe5382447db512bb8845c725fa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:57:55.497520 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:57:55.857026 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:47.190119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:47.191588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:47.203408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ad0688-3ec7-433b-b730-29ac13eb5a5e service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:47.251994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:47.252599 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:47.252884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:47.253156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:47.255184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:47.330084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:47.331543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ddf44-64dd-4691-b3b2-83baee1ed5ee service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:47.342472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1235/2452] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:58:47.433365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:47.434945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:47.447716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701314e-ffda-4e3e-aecb-597ba691bbe1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:47.456361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:47.457227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:47.457493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:47.457779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:47.459629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:47.474689 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:47.476161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:47.488787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1218/2453] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 04:58:48.890092 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:48.890593 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:48.890796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:48.911170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] MFA Rules not processed for user `e87c835bd666445a826bd7e7871023c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:58:48.912420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:48.972636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1236/2454] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 04:58:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:58:57.488177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:58.965458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=79 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:58:59.671573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:58:59.673036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:59.729488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5723f9ae-9346-49c1-931e-6ba69e932280 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:58:59.733048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:58:59.733652 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:58:59.733930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:58:59.734248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:58:59.736003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:58:59.800272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:58:59.801720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:58:59.812275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1219/2455] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:58:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:09.806856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=48 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:19.488866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:19.491258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:19.505927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025586c-b801-4dba-bf8a-736982ab0dc0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:19.513849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:19.513849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:19.513849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:19.513849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:19.515496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:19.526053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:19.527775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871572c-27b6-4a6a-b87c-409980cdd36a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:19.537892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1237/2456] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.008003 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.009498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.026275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d33af3-72f4-4e64-bb8d-a02203513737 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:26.032457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:26.033062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.033345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.033661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.035554 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.048568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:26.050197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:26.061825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1220/2457] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:26.716659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:26.717136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:26.717226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:26.738373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 04:59:26.739611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:26.917595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1238/2458] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 04:59:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 04:59:26.964697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:26.966104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:27.035445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4952094-ef63-44d3-a067-2e421d55b883 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:27.040972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:27.041579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:27.041867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:27.042141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:27.050094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:27.051887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:27.060328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1221/2459] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 04:59:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 04:59:30.468706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:30.470137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:30.554583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296c031-95d6-47e4-a493-522c7c422f22 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:30.560215 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:30.560822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:30.561097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:30.561362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:30.563117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:30.576222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:30.577723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:30.588028 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1239/2460] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:33.630051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:33.642784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3777a-36a0-4bf5-855f-edfdf8d5e39f service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:33.647893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:33.648493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:33.648774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:33.649048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:33.651352 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:33.663429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:33.665051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:33.677602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1222/2461] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:33.696745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:33.698144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:33.770933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe8fa8-f418-4e92-981c-2988470ce68e service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:33.775871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:33.776575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:33.776847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:33.777110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] PATH_INFO: `/v3/users/bf41bacfc4214e26bfbbeafe7186bf37` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:33.778227 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf41bacfc4214e26bfbbeafe7186bf37)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:33.780140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:33.803485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:33.828877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf41bacfc4214e26bfbbeafe7186bf37'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:33.829522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf41bacfc4214e26bfbbeafe7186bf37'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:33.830189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf41bacfc4214e26bfbbeafe7186bf37'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:33.837061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf41bacfc4214e26bfbbeafe7186bf37'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:33.845462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf41bacfc4214e26bfbbeafe7186bf37'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:33.862880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1240/2462] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:33 2022] DELETE /identity/v3/users/bf41bacfc4214e26bfbbeafe7186bf37 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:34.035264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:34.047948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e565d-2cf5-456d-bd40-a5c8192f432a service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:34.106478 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:34.107108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:34.107390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:34.107700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] PATH_INFO: `/v3/projects/6497096b55a1411abaff8c2f80d3eb08` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:34.108810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6497096b55a1411abaff8c2f80d3eb08)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:34.110712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:34.158044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6497096b55a1411abaff8c2f80d3eb08', 'request_id': 'req-ac8b4aee-f302-4710-9f82-739471d5e42d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.164383 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6497096b55a1411abaff8c2f80d3eb08', 'request_id': 'req-ac8b4aee-f302-4710-9f82-739471d5e42d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.169970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6497096b55a1411abaff8c2f80d3eb08', 'request_id': 'req-ac8b4aee-f302-4710-9f82-739471d5e42d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.172490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:34.183866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] The token cache is being invalidate because project 6497096b55a1411abaff8c2f80d3eb08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:34.184155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.184811 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.186295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1223/2463] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:34 2022] DELETE /identity/v3/projects/6497096b55a1411abaff8c2f80d3eb08 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 04:59:34.190296 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:34.191760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:34.205187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe192d-c7d5-4e37-9915-6f089fc6cbde admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:34.262804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:34.263429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:34.263736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:34.264004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] PATH_INFO: `/v3/users/4e9a8d0bfe404695aac2758db670f248` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:34.265112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e9a8d0bfe404695aac2758db670f248)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:34.266997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:34.311758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e9a8d0bfe404695aac2758db670f248'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.312418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e9a8d0bfe404695aac2758db670f248'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.313029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e9a8d0bfe404695aac2758db670f248'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.319966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e9a8d0bfe404695aac2758db670f248'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.328332 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e9a8d0bfe404695aac2758db670f248'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.345703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1241/2464] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 04:59:34 2022] DELETE /identity/v3/users/4e9a8d0bfe404695aac2758db670f248 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:34.517873 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:34.519322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:34.532741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b4aee-f302-4710-9f82-739471d5e42d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:34.590998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:34.591669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:34.591959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:34.592236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] PATH_INFO: `/v3/projects/a3ae98bde67447d09a9cda491b46ecdc` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:34.593346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3ae98bde67447d09a9cda491b46ecdc)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:34.595259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:34.642745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3ae98bde67447d09a9cda491b46ecdc', 'request_id': 'req-b78b18a4-8d8f-4812-bfba-80f1749d58ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.648996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3ae98bde67447d09a9cda491b46ecdc', 'request_id': 'req-b78b18a4-8d8f-4812-bfba-80f1749d58ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.654447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3ae98bde67447d09a9cda491b46ecdc', 'request_id': 'req-b78b18a4-8d8f-4812-bfba-80f1749d58ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.668733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] The token cache is being invalidate because project a3ae98bde67447d09a9cda491b46ecdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 04:59:34.669258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.670212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 04:59:34.672148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1224/2465] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 04:59:34 2022] DELETE /identity/v3/projects/a3ae98bde67447d09a9cda491b46ecdc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 04:59:44.342289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=73,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:44.663673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 04:59:52.368819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:52.370240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:52.427172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb675c-0b5a-43a8-9cfe-39a6cf9ae84c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:52.475161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:52.475805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:52.476086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:52.476358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:52.478388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:52.538860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:52.540546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:52.549567 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1242/2466] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 04:59:57.331594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 04:59:57.333054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:57.347181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b18a4-8d8f-4812-bfba-80f1749d58ae admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 04:59:57.351097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 04:59:57.351829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 04:59:57.352183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 04:59:57.353114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 04:59:57.361429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 04:59:57.426236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 04:59:57.427709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 04:59:57.439054 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1225/2467] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 04:59:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:00.405761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:00.407881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:00.520660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ccba8-00e8-4ffa-8ce0-3dc636d40ff9 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:00.530620 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:00.531241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:00.531546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:00.532265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:00.534243 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:00.545417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=100 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:00.548054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:00.549908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43b631-0f51-4dae-b04f-2ab5306c9398 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:00.563273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1243/2468] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:03.470670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.472198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.534421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cdc595-deb8-46b3-8eca-f59d814ca2a5 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.539036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.539866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.540149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.540427 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.542205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.552736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.554246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b4e6f-6f34-48dc-98c1-e3fb68f42da2 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.563895 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1226/2469] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:03.698758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.699639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.700063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.712097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1244/2470] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:00:03 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:00:03.716660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcca479-60f7-4ea5-8cf8-e70c860688ae None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.716996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcca479-60f7-4ea5-8cf8-e70c860688ae None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.718324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcca479-60f7-4ea5-8cf8-e70c860688ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.744867 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4dcca479-60f7-4ea5-8cf8-e70c860688ae None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:03.746195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4dcca479-60f7-4ea5-8cf8-e70c860688ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.756936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1227/2471] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:03.772070 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.774570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.788683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f205bc2-6a5e-4b40-8c17-7d36fc4962c4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.794625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.795439 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.795936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.796385 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.806944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:03.809163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa1e756-6cde-49bd-a6e2-d106ea744d1a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:03.818117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1245/2472] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:03.907868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab4e-ee6a-485e-ab4f-3cf3f3fe5025 None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.908156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab4e-ee6a-485e-ab4f-3cf3f3fe5025 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.908429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edab4e-ee6a-485e-ab4f-3cf3f3fe5025 None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.909803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1228/2473] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:00:03.916551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.916939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.917241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.937781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:03.939162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:03.954018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1246/2474] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:00:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:03.967747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edab4e-ee6a-485e-ab4f-3cf3f3fe5025 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:03.981361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edab4e-ee6a-485e-ab4f-3cf3f3fe5025 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:03.985628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:03.986522 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:03.986800 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:03.987095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:03.999816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.001279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654c0997-e77e-4c58-8c77-1d21ac0a19a5 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.014748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1229/2475] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:04.106643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:04.108343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:04.193908 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcbb2d-1978-4958-bc20-3b8ff3bfeac1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:04.200323 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:04.201123 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:04.201552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:04.201973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:04.204003 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:04.217706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:04.219377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:04.232807 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1247/2476] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:05.234185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea9d9-ee79-41ba-a45d-7c059778739d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:05.234814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea9d9-ee79-41ba-a45d-7c059778739d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:05.234814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dea9d9-ee79-41ba-a45d-7c059778739d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:05.253475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-42dea9d9-ee79-41ba-a45d-7c059778739d None None] MFA Rules not processed for user `7da49f610a644878bd319fea57b1b5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:05.254725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-42dea9d9-ee79-41ba-a45d-7c059778739d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:05.261740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1230/2477] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:07.505637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:07.522336 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ebc4d-a72e-45de-8912-c95fbbe7154e service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:07.531938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:07.532562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:07.532832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:07.533104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:07.534861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:07.548592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:07.550182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:07.563133 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1248/2478] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:00:08.497658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:08.498069 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:08.498300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:08.519061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] MFA Rules not processed for user `5eadf34dc91e4dd79d00a9e218117032`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:08.520398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:08.575423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1231/2479] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:17.558633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=49 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.568265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:18.740140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:18.749366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b72af8-92f5-4a2f-9a21-6e55ff2f635b service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:18.752920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:18.753509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:18.753786 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:18.754058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:18.755798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:18.827153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:18.828623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:18.839159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1249/2480] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:22.938901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:22.940950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:22.956018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc517-8589-40a4-8e10-6e3bf95cfe2c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:22.961637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:22.962450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:22.962734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:22.963033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] PATH_INFO: `/v3/users/e87c835bd666445a826bd7e7871023c9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:22.964611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e87c835bd666445a826bd7e7871023c9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:22.967180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.017919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e87c835bd666445a826bd7e7871023c9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.018587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e87c835bd666445a826bd7e7871023c9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.026806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e87c835bd666445a826bd7e7871023c9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.027526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e87c835bd666445a826bd7e7871023c9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.034759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1f2c4106-ec36-4b1a-8959-a6196d6ae36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e87c835bd666445a826bd7e7871023c9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.052305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1232/2481] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:00:22 2022] DELETE /identity/v3/users/e87c835bd666445a826bd7e7871023c9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:23.315784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.326428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c9745-9d8e-4fc3-b742-a7c162c6b7e8 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.384789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.385537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.385981 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.386283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] PATH_INFO: `/v3/projects/aec41d54d2e54cdd80b463f1c8af9b84` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.387732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec41d54d2e54cdd80b463f1c8af9b84)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.390007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.449136 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec41d54d2e54cdd80b463f1c8af9b84', 'request_id': 'req-93a33070-be8d-4067-a420-bdc5673e06c4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.457247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec41d54d2e54cdd80b463f1c8af9b84', 'request_id': 'req-93a33070-be8d-4067-a420-bdc5673e06c4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.465904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec41d54d2e54cdd80b463f1c8af9b84', 'request_id': 'req-93a33070-be8d-4067-a420-bdc5673e06c4'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.477700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] The token cache is being invalidate because project aec41d54d2e54cdd80b463f1c8af9b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:00:23.478059 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.478700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-93a33070-be8d-4067-a420-bdc5673e06c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:00:23.480207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1250/2482] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:00:23 2022] DELETE /identity/v3/projects/aec41d54d2e54cdd80b463f1c8af9b84 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:00:23.485453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.485901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.486763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.508039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:23.509337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:23.576334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1233/2483] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:23.584466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.584745 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.585015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.606760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:23.608022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:23.616091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1251/2484] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:23.620515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.630802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364c1de-1b2a-445d-aede-aaed2ce5cae4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.636255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.636945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.637249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.637521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.638166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:00:23.638466 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.640130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.653007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1234/2485] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:00:23.657485 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.667447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3b74-9386-493e-b0f6-a066fbbdda74 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.672355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.672952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.673226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.673494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.674393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.676465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.698196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:23.713570 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1252/2486] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:00:23 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:00:23.718007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.728788 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee0bb0-3031-4e41-bb98-94c976c40e0f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.800576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.801231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.801513 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.801786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.802457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.804994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.813254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:23.830511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1235/2487] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:00:23 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:00:23.834553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.845006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca028ce5-ce68-4eb9-bcd1-b4ae55a28502 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.849941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.850672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.850875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.851165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.852208 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.853387 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.865376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1253/2488] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:23.869099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.880191 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad96eed-dd4b-4437-8117-b3540f619bcb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.885839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.886528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.886808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.887081 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.887765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.889354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb5d2b-7e23-40c7-bb26-a2b648d10213 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.900887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1236/2489] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:00:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:00:23.905590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:23.916247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37851acf-a26f-4a30-b448-8b2e9aed9db4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:23.920805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:23.921453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.921727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.921998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] PATH_INFO: `/v3/projects/d8c9aacf135a44fcb9f1b0305b787fd2/users/cfd09631436b4f85b39ca53614f214e9/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.938525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c9aacf135a44fcb9f1b0305b787fd2, user_id=cfd09631436b4f85b39ca53614f214e9, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:23.941271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:23.955564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1254/2490] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:00:23 2022] PUT /identity/v3/projects/d8c9aacf135a44fcb9f1b0305b787fd2/users/cfd09631436b4f85b39ca53614f214e9/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:00:23.960838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0abb9-aa4d-41cb-96bb-dbcf59a73d22 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:23.961377 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0abb9-aa4d-41cb-96bb-dbcf59a73d22 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:23.961547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0abb9-aa4d-41cb-96bb-dbcf59a73d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:23.980306 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7dd0abb9-aa4d-41cb-96bb-dbcf59a73d22 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:23.981521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7dd0abb9-aa4d-41cb-96bb-dbcf59a73d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:24.047402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1237/2491] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:24.056686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:24.059024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:24.121794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d908ca-ba8f-4eb9-ac66-dd28c479579d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:24.125502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:24.126112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:24.126393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:24.126663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:24.136294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:24.137775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:24.149839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1255/2492] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:28.993792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9a48-ede9-4744-8439-df97bdeeeb84 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:28.994353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9a48-ede9-4744-8439-df97bdeeeb84 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:28.994353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc9a48-ede9-4744-8439-df97bdeeeb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.061019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e8fc9a48-ede9-4744-8439-df97bdeeeb84 None None] MFA Rules not processed for user `cfd09631436b4f85b39ca53614f214e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:29.062517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e8fc9a48-ede9-4744-8439-df97bdeeeb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.144889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1238/2493] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:28 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:00:29.160294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:00:29.164031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:29.274480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b6774-e575-4db4-abea-335ab3c5041c service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:00:29.281013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:00:29.281639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:29.281917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:29.282186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:29.296224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:00:29.297975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:00:29.316443 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1256/2494] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:00:29 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:00:31.065612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:00:31.066142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:00:31.066500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:00:31.087084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] MFA Rules not processed for user `cfd09631436b4f85b39ca53614f214e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:00:31.088337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:00:31.095184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1239/2495] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:00:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:00:39.304361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:00:41.080901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:01:51.974251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:51.994721 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fc460-e009-4c53-9caa-6ba2742e5a71 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:51.998414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:51.999013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:51.999288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:51.999597 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:52.001329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:52.088436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:52.089859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:52.098752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1257/2496] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:01:57.099197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:01:57.132236 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9789e-9fa7-4662-89c9-b9d8725a7367 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:01:57.136730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:01:57.137414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:01:57.137748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:01:57.138051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:01:57.139859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:01:57.186535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:01:57.188060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:01:57.209755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1240/2497] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:02.094764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=43 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:04.071065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:04.072491 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:04.090206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854dce0-477e-416a-8fd2-993a04fa45e3 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:04.096732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:04.098181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:04.098475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:04.098921 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] PATH_INFO: `/v3/users/7432fd6923ca4343b82b1368156bec23` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:04.100369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7432fd6923ca4343b82b1368156bec23)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:04.102295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:04.154800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7432fd6923ca4343b82b1368156bec23'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.155752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7432fd6923ca4343b82b1368156bec23'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.156403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7432fd6923ca4343b82b1368156bec23'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.163985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7432fd6923ca4343b82b1368156bec23'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.173458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7432fd6923ca4343b82b1368156bec23'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.193617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1258/2498] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:04 2022] DELETE /identity/v3/users/7432fd6923ca4343b82b1368156bec23 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:04.373772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:04.392287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeeb5a1-53c6-474c-b7f4-207522c44d18 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:04.453122 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:04.454020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:04.454448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:04.454887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] PATH_INFO: `/v3/projects/4d7c13a5d23c4422899c5e2c7eb650f5` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:04.456219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7c13a5d23c4422899c5e2c7eb650f5)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:04.458114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:04.522130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7c13a5d23c4422899c5e2c7eb650f5', 'request_id': 'req-74963226-4162-44a9-a4fd-ce5b5acc69e9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.532310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7c13a5d23c4422899c5e2c7eb650f5', 'request_id': 'req-74963226-4162-44a9-a4fd-ce5b5acc69e9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.539093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7c13a5d23c4422899c5e2c7eb650f5', 'request_id': 'req-74963226-4162-44a9-a4fd-ce5b5acc69e9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.552710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] The token cache is being invalidate because project 4d7c13a5d23c4422899c5e2c7eb650f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:04.552997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.553647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.555137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1241/2499] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:04 2022] DELETE /identity/v3/projects/4d7c13a5d23c4422899c5e2c7eb650f5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:04.559980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:04.561388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:04.574413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e7c93-5d44-4233-98b8-4c6cb512b575 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:04.631872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:04.632516 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:04.632797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:04.633072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] PATH_INFO: `/v3/users/1346f58da17e42658ec8086ae57a143f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:04.634222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1346f58da17e42658ec8086ae57a143f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:04.636820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:04.700585 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1346f58da17e42658ec8086ae57a143f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.701456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1346f58da17e42658ec8086ae57a143f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.702578 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1346f58da17e42658ec8086ae57a143f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.716379 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1346f58da17e42658ec8086ae57a143f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.730239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1346f58da17e42658ec8086ae57a143f'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:04.740203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:04.757025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1259/2500] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:04 2022] DELETE /identity/v3/users/1346f58da17e42658ec8086ae57a143f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:05.023743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:05.025536 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:05.042843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74963226-4162-44a9-a4fd-ce5b5acc69e9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:05.065845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:05.114731 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:05.115313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:05.115630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:05.115908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] PATH_INFO: `/v3/projects/304d11ee08c64b2587b85d4de4207cd2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:05.117251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=304d11ee08c64b2587b85d4de4207cd2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:05.119155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:05.173110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304d11ee08c64b2587b85d4de4207cd2', 'request_id': 'req-e5ac556d-cc04-4c0b-b754-c89127800069'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:05.179386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304d11ee08c64b2587b85d4de4207cd2', 'request_id': 'req-e5ac556d-cc04-4c0b-b754-c89127800069'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:05.185957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304d11ee08c64b2587b85d4de4207cd2', 'request_id': 'req-e5ac556d-cc04-4c0b-b754-c89127800069'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:05.199694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] The token cache is being invalidate because project 304d11ee08c64b2587b85d4de4207cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:05.199982 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:05.200614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e5ac556d-cc04-4c0b-b754-c89127800069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:05.202386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1242/2501] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:05 2022] DELETE /identity/v3/projects/304d11ee08c64b2587b85d4de4207cd2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:05.609420 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:05.611010 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:05.714681 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfe86e-13a1-4c5b-862a-67ec103937d5 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:05.781197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:05.781912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:05.782266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:05.782615 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:05.784957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:05.800374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:05.802103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:05.813376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1260/2502] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:09.110731 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:09.111298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:09.111298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:09.131163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] MFA Rules not processed for user `5eadf34dc91e4dd79d00a9e218117032`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:09.132389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:09.193319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1243/2503] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:15.810682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=70,keystone:DELETE=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:19.100307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:19.101766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:19.169698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba91593-f689-40a6-bf98-423125b25a09 service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:19.173311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:19.173909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:19.174185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:19.174459 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:19.176187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:19.186375 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:19.240388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:19.241802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:19.253267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1261/2504] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:23.222761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:23.224909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:23.243743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9f1f-fadc-4c4e-98bb-79133873488b None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:23.248477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:23.249111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:23.249401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:23.249674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] PATH_INFO: `/v3/users/7da49f610a644878bd319fea57b1b5b8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:23.250806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7da49f610a644878bd319fea57b1b5b8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:23.252753 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:23.302555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7da49f610a644878bd319fea57b1b5b8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.303211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7da49f610a644878bd319fea57b1b5b8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.312099 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7da49f610a644878bd319fea57b1b5b8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.312714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7da49f610a644878bd319fea57b1b5b8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.319978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72f0dbd0-54be-4696-b71f-5655b669be06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7da49f610a644878bd319fea57b1b5b8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.339369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1244/2505] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:23 2022] DELETE /identity/v3/users/7da49f610a644878bd319fea57b1b5b8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:23.642292 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:23.653822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409232fd-2d97-40c9-80ab-28a87a91512f service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:23.745044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:23.745683 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:23.745964 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:23.746289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] PATH_INFO: `/v3/projects/26a288d5414446e68974ff81e6fe6bdc` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:23.747627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26a288d5414446e68974ff81e6fe6bdc)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:23.749577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:23.796882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:23.804502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26a288d5414446e68974ff81e6fe6bdc', 'request_id': 'req-65c22faa-efcc-42e2-a567-d4a55df9c0d8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.811054 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26a288d5414446e68974ff81e6fe6bdc', 'request_id': 'req-65c22faa-efcc-42e2-a567-d4a55df9c0d8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.821250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26a288d5414446e68974ff81e6fe6bdc', 'request_id': 'req-65c22faa-efcc-42e2-a567-d4a55df9c0d8'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.835228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] The token cache is being invalidate because project 26a288d5414446e68974ff81e6fe6bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:23.835554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.836239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-65c22faa-efcc-42e2-a567-d4a55df9c0d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:23.839564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1262/2506] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:23 2022] DELETE /identity/v3/projects/26a288d5414446e68974ff81e6fe6bdc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:23.842858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:23.843144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:23.843419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:23.908562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:23.910043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:24.012162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1245/2507] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:24.013063 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.013818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.014222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.043775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:24.045270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:24.055617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1263/2508] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:02:24.060448 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.071372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a6cfc-8a2e-4c65-953a-8310cc91b5c5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.077799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.078748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.079120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.079492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.080221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:24.080595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.082878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.097745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1246/2509] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:02:24.101970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.112469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c305ed-f980-42a7-81d6-00cea808702e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.117430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.118027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.118303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.118568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.119912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.121802 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.151896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1264/2510] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:24 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:24.156116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.166621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aef056-fd26-4a30-a89c-2d090fc6a5aa admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.193279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:24.229323 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.230047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.230197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.230467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.231094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.233058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.262572 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1247/2511] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:24 2022] POST /identity/v3/users => generated 283 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:02:24.267018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.278111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eb9ad-39dc-4ed0-a3bf-eeb26b9615e8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.282977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.283626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.283910 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.284182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.285135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.286834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.298645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1265/2512] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:02:24.302789 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.313031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8744c3-40b0-498e-9741-1a9c03833f8d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.317972 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.318574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.318848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.319117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.319792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.321386 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c8c67-aa8f-4460-ae4f-7e1b6a6c99f3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.332183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1248/2513] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:24.336497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.347247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd2805-32eb-442e-bad2-3a21cafc4690 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.351984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.352637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.352912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.353206 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] PATH_INFO: `/v3/projects/2e0b7ba82adf4784b8fc7c8f4a1c2ca4/users/0559490bf980420a86ce03c30899d890/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.370086 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0b7ba82adf4784b8fc7c8f4a1c2ca4, user_id=0559490bf980420a86ce03c30899d890, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.372781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.387763 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1266/2514] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:24 2022] PUT /identity/v3/projects/2e0b7ba82adf4784b8fc7c8f4a1c2ca4/users/0559490bf980420a86ce03c30899d890/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:24.397932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.398219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.398496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.428981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] MFA Rules not processed for user `0559490bf980420a86ce03c30899d890`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:24.430227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:24.504857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1249/2515] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:24.516024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:24.517656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:24.601492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8db5-7cf8-4cc6-a899-e0dd81a4e33d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:24.606846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:24.607575 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:24.607925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:24.608263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:24.617328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:24.618735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fb0ad-d9c1-4683-ab4d-b0f53e70cfe7 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:24.627816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1267/2516] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:33.038983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:33.101610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d4d2f-161a-4c1b-9846-7278aad60af9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:33.106953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:33.107602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.107883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.108164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] PATH_INFO: `/v3/users/0559490bf980420a86ce03c30899d890` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.109276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0559490bf980420a86ce03c30899d890)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:33.111195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:33.152868 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:33.160575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0559490bf980420a86ce03c30899d890'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.161197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0559490bf980420a86ce03c30899d890'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.169133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0559490bf980420a86ce03c30899d890'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.169887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0559490bf980420a86ce03c30899d890'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.177060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0559490bf980420a86ce03c30899d890'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.195607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1250/2517] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:33 2022] DELETE /identity/v3/users/0559490bf980420a86ce03c30899d890 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:33.200455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.200953 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.201110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.220274 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:33.221465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:33.265129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:33.282594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1268/2518] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:33.293332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:33.294740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:33.352353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ee0d3-3ef0-496a-90ac-9eebb80c8e8c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:33.356668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:33.357273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.357553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.357825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.367112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:33.368639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4f9692-c1dc-4ef2-ba9c-329227f981d3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:33.379132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1251/2519] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:33.740568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:33.742056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:33.755937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4174681c-fbef-49d4-92af-06e9a6a3a9e6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:33.761624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:33.762283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.762564 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.762834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] PATH_INFO: `/v3/projects/2e0b7ba82adf4784b8fc7c8f4a1c2ca4` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.764025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0b7ba82adf4784b8fc7c8f4a1c2ca4)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:33.765987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:33.814160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0b7ba82adf4784b8fc7c8f4a1c2ca4', 'request_id': 'req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.819692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0b7ba82adf4784b8fc7c8f4a1c2ca4', 'request_id': 'req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.827894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0b7ba82adf4784b8fc7c8f4a1c2ca4', 'request_id': 'req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.839687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] The token cache is being invalidate because project 2e0b7ba82adf4784b8fc7c8f4a1c2ca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:33.839994 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.840664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-193ab099-aa9a-4e59-ae57-899f2b3b8cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:33.842288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1269/2520] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:33 2022] DELETE /identity/v3/projects/2e0b7ba82adf4784b8fc7c8f4a1c2ca4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:33.848188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.848548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.848897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.868091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:33.869295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:33.929211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1252/2521] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:33.937732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.938004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.938280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.957526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:33.958722 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:33.967096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1270/2522] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:33.971148 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:33.981358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb048d2-19e3-4cfc-8d75-3e5a035dd6fc None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:33.985860 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:33.986442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:33.986718 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:33.986992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:33.987664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:33.987965 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:33.989529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.001016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1253/2523] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:34.005484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.015258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe8d48e-cd25-4588-bdd6-434638793f8e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.020386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.020988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.021269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.021544 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.022177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.024107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.052749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1271/2524] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:34.057244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.067292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8183b4-82d9-4b5c-982f-2ce5614a0268 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.109911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:34.124297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.124920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.125414 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.125691 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.126322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.128245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.149269 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1254/2525] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:02:34.154077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.164608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6a5119-8234-4d3a-b100-d1feaaa994a0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.169880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.170471 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.170750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.171022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.171686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.173272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.183220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1272/2526] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:34.187221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.197024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a95031e-c5cd-4da1-9d04-4caac795e6d2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.201713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.202302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.202608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.202879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.203544 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.205109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9daa2a4-ec87-4c88-b297-c55ab15655b3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.216282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1255/2527] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:34.220191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.231756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd207b7-d23a-4f22-904d-debb2ead93cd admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.236477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.237113 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.237393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.237667 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] PATH_INFO: `/v3/projects/c09d083e6fc840efbdd05121f364b150/users/0e40c38c10d741b8b9e7eb797070a94b/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.252189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09d083e6fc840efbdd05121f364b150, user_id=0e40c38c10d741b8b9e7eb797070a94b, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.254820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.267304 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1273/2528] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:34 2022] PUT /identity/v3/projects/c09d083e6fc840efbdd05121f364b150/users/0e40c38c10d741b8b9e7eb797070a94b/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:34.278486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.278772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.279047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.306862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] MFA Rules not processed for user `0e40c38c10d741b8b9e7eb797070a94b`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:34.308490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:34.376793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1256/2529] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:34.381230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.442989 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bebda-add5-4363-9943-6cb54c10d827 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.448267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.448901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.449183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.449454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.450082 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.452005 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.467041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:34.484549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1274/2530] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:34.485745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.496678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a2ceb8-24a2-4485-a129-8d966fc93f2a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.555658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.556259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.556535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.556874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.557494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.559374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.580036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1257/2531] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:34.584057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.594866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c36af-ee54-4d55-8b09-5981afebb824 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.599460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.600081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.600883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.600883 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.601241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.602816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.614315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1275/2532] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:34.618662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.629138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac86316-4de9-4f86-b630-86da76b6de08 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.633654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.634301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.634575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.635372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] PATH_INFO: `/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f/users/07bcdfa5632d498ba1757766799fddb9/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.656310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a79b9bb6a644efacc7e69ccaaa535f, user_id=07bcdfa5632d498ba1757766799fddb9, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.660178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.679046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1258/2533] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:34 2022] PUT /identity/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f/users/07bcdfa5632d498ba1757766799fddb9/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:34.684022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.694556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a8839-6bfe-4853-b6ec-a3050a2e8590 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.754691 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.755362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.755673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.755975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.756803 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.758436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8cc41-1576-4fc3-a159-2f37bfb47c46 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.769357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1276/2534] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:34.773509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.783963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cefbdf-d83f-4b23-a6e1-7d0feb27c874 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.788817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.789461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.789749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.790021 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] PATH_INFO: `/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f/users/07bcdfa5632d498ba1757766799fddb9/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.792170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04a79b9bb6a644efacc7e69ccaaa535f, user_id=07bcdfa5632d498ba1757766799fddb9, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:34.794775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:34.804854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1259/2535] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:34 2022] PUT /identity/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f/users/07bcdfa5632d498ba1757766799fddb9/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:34.816839 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.817121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:34.817389 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:34.846947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] MFA Rules not processed for user `07bcdfa5632d498ba1757766799fddb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:34.848170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:34.914465 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1277/2536] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:34.925782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:34.927487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:34.938329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:34.993267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac20e5d-dc6e-483c-bcc6-e5098273e848 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:34.998297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:34.998903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:34.999181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.000272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.010724 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:35.012181 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbf7be-a45b-444f-a453-9a3a8b3b89a4 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:35.021920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1260/2537] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:35.086702 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:35.148952 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30faed-1663-49fb-9f45-48754b3aab26 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:35.153753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:35.154388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:35.154663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.154933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] PATH_INFO: `/v3/users/0e40c38c10d741b8b9e7eb797070a94b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.156083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e40c38c10d741b8b9e7eb797070a94b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:35.158058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:35.163122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:35.206728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e40c38c10d741b8b9e7eb797070a94b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.207298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e40c38c10d741b8b9e7eb797070a94b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.207937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e40c38c10d741b8b9e7eb797070a94b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.214832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e40c38c10d741b8b9e7eb797070a94b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.222017 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e40c38c10d741b8b9e7eb797070a94b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.239739 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1278/2538] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:35 2022] DELETE /identity/v3/users/0e40c38c10d741b8b9e7eb797070a94b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:35.244979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:35.245516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.245721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.265517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:35.266732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:35.325209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1261/2539] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:35.335018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:35.336432 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:35.393698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d9967-7c8c-4d17-a437-c7e4ffe883b3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:35.397325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:35.397925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:35.398204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.398477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.408064 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:35.409737 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:35.419011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1279/2540] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:35.688796 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:35.690257 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:35.704258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db80b3a-2662-4c0d-a397-ab3566a7eee3 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:35.708902 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:35.709529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:35.709803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.710072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] PATH_INFO: `/v3/projects/c09d083e6fc840efbdd05121f364b150` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.711207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09d083e6fc840efbdd05121f364b150)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:35.713668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:35.761955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09d083e6fc840efbdd05121f364b150', 'request_id': 'req-95df66a1-7cde-473e-b958-685126f0766c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.768635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09d083e6fc840efbdd05121f364b150', 'request_id': 'req-95df66a1-7cde-473e-b958-685126f0766c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.774225 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09d083e6fc840efbdd05121f364b150', 'request_id': 'req-95df66a1-7cde-473e-b958-685126f0766c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.790025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] The token cache is being invalidate because project c09d083e6fc840efbdd05121f364b150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:35.790298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.790948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.792806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1262/2541] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:35 2022] DELETE /identity/v3/projects/c09d083e6fc840efbdd05121f364b150 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:35.796694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:35.806376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c663eb-e648-4efe-ac19-5f97587ca511 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:35.866102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:35.866733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:35.867008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:35.867277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] PATH_INFO: `/v3/users/07bcdfa5632d498ba1757766799fddb9` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:35.868419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bcdfa5632d498ba1757766799fddb9)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:35.871047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:35.900724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:35.921973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bcdfa5632d498ba1757766799fddb9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.922634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bcdfa5632d498ba1757766799fddb9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.923252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bcdfa5632d498ba1757766799fddb9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.930204 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bcdfa5632d498ba1757766799fddb9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.940152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-334cb2c7-7868-4275-85f7-96827f8412cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bcdfa5632d498ba1757766799fddb9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:35.958863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1280/2542] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:35 2022] DELETE /identity/v3/users/07bcdfa5632d498ba1757766799fddb9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:36.227740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.229754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:36.243441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df66a1-7cde-473e-b958-685126f0766c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.275881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:36.304574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.305127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.305401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.305669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] PATH_INFO: `/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.306844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04a79b9bb6a644efacc7e69ccaaa535f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.309059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.356153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04a79b9bb6a644efacc7e69ccaaa535f', 'request_id': 'req-c2468b58-c3d2-4992-8fc8-a447e792037a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:36.362188 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04a79b9bb6a644efacc7e69ccaaa535f', 'request_id': 'req-c2468b58-c3d2-4992-8fc8-a447e792037a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:36.367625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04a79b9bb6a644efacc7e69ccaaa535f', 'request_id': 'req-c2468b58-c3d2-4992-8fc8-a447e792037a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:36.379746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] The token cache is being invalidate because project 04a79b9bb6a644efacc7e69ccaaa535f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:36.380027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:36.380637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-c2468b58-c3d2-4992-8fc8-a447e792037a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:36.382090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1263/2543] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:36 2022] DELETE /identity/v3/projects/04a79b9bb6a644efacc7e69ccaaa535f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:36.386961 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.387426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.387566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.407431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:36.408672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:36.468414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1281/2544] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:36.476142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.476424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.476698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.496881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:36.498071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:36.505889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1264/2545] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:36.510137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.520043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca80cc-cfc9-42b8-8f96-fbc82ce39b61 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.524558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.525147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.526033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.526409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.527051 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:36.527352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.528965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.547244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1282/2546] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:36.551512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.560880 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9cf5c-9ac2-4a8e-9bcb-d0642df8694d None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.565475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.566059 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.566333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.566605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.567227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.569622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.597714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1265/2547] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:02:36.601848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.612700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4b6b-3bc1-412c-b388-4ede7170b1b7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.675139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.676130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.676556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.677002 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.677822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.679975 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.704217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1283/2548] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:36.708389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.719089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07919c1a-d807-4a69-afac-964ff322fa1b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.723783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.724380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.724659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.724929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.725564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.727130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.737778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1266/2549] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:02:36.741660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.752629 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d5535-d86c-4640-bbb0-beda43eb6156 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.757665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.758311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.758590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.758861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.759572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.762146 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788c762-3b30-4201-9277-d0b67978081b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.772326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1284/2550] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:36.777341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:36.788042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c176ac1-6d0e-43c9-8a35-99086266f598 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:36.792853 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:36.793537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.793817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.794092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] PATH_INFO: `/v3/projects/2cac450636194dfc8ab7d810a2a14ede/users/4ad10769b5244dc19a57147427aec499/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.809159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cac450636194dfc8ab7d810a2a14ede, user_id=4ad10769b5244dc19a57147427aec499, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:36.811915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:36.829163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1267/2551] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:36 2022] PUT /identity/v3/projects/2cac450636194dfc8ab7d810a2a14ede/users/4ad10769b5244dc19a57147427aec499/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:36.840031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:36.840391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:36.840764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:36.862384 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:36.871727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] MFA Rules not processed for user `4ad10769b5244dc19a57147427aec499`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:36.873636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:36.937548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1285/2552] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:36.942198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.006659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425a7f5-ea61-42b9-b761-f70cb1e73b5f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.012331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.012898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.013166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.013439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.014066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.015986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.020812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:37.044543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1268/2553] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:36 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:37.048641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.060351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30651-da07-4ade-a92a-3cecf71d49d6 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.119285 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.119938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.120245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.120521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.121142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.123046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.149068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1286/2554] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:37 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:02:37.150261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.161486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c8772-6f73-4f35-9acd-d6f6e484052b admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.166647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.167336 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.167651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.167924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.168558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.170136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.180038 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1269/2555] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:37.184327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.194310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b3131-99f1-4ac1-bc6f-b1d6fb913d1c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.199018 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.199687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.199962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.200229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] PATH_INFO: `/v3/projects/600a2d50c487429988e4f7e9f22fdfa8/users/997741dad62c4f1b87493b12baf7656b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.215542 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600a2d50c487429988e4f7e9f22fdfa8, user_id=997741dad62c4f1b87493b12baf7656b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.218156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.230927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1287/2556] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:37 2022] PUT /identity/v3/projects/600a2d50c487429988e4f7e9f22fdfa8/users/997741dad62c4f1b87493b12baf7656b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:37.234795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.245004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992512b-f639-4baa-922f-e37225f7aeea admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.301820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.302470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.302700 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.302974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.303646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.305245 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366fef9-6889-4ea9-b340-5593e3c8712c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.314967 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1270/2557] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:37.319062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.330383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9e58f-6df6-4f62-a65e-206260e81b15 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.335224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.335912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.336189 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.336458 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] PATH_INFO: `/v3/projects/600a2d50c487429988e4f7e9f22fdfa8/users/997741dad62c4f1b87493b12baf7656b/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.338957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=600a2d50c487429988e4f7e9f22fdfa8, user_id=997741dad62c4f1b87493b12baf7656b, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.341600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.352170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1288/2558] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:37 2022] PUT /identity/v3/projects/600a2d50c487429988e4f7e9f22fdfa8/users/997741dad62c4f1b87493b12baf7656b/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:37.364218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.364537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.364818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.392878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] MFA Rules not processed for user `997741dad62c4f1b87493b12baf7656b`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:37.394096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:37.463614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1271/2559] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:37.474991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.476806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:37.534854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d4d8-1297-4080-a4c3-4e1d60464325 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.538657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.539571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.539852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.540125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.548048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:37.550700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.552600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.563776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1289/2560] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:02:37.651223 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:37.661382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a060f-7be8-42d7-ac54-8d79a7041d83 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:37.665049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:37.665643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:37.666430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:37.666714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:37.722166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:37.726715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:37.728365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbb06b-ae07-4ac6-8511-18820c905bae service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:37.738312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1272/2561] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:42.513419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:42.576894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cd6ca1-1022-4a34-a561-814e9ba114db service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:42.581487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:42.582115 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:42.582428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:42.582698 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] PATH_INFO: `/v3/users/4ad10769b5244dc19a57147427aec499` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:42.583848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad10769b5244dc19a57147427aec499)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:42.585757 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:42.634642 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad10769b5244dc19a57147427aec499'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:42.635223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad10769b5244dc19a57147427aec499'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:42.635811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad10769b5244dc19a57147427aec499'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:42.642832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad10769b5244dc19a57147427aec499'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:42.650032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad10769b5244dc19a57147427aec499'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:42.668076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1290/2562] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:42 2022] DELETE /identity/v3/users/4ad10769b5244dc19a57147427aec499 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:42.672638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:42.673123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:42.673220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:42.692429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:42.693640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:42.751002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1273/2563] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:42.761455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:42.762888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:42.825960 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06b065-96a5-4db3-b2c3-a755f349f656 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:42.829633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:42.830291 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:42.830568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:42.830835 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:42.839846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:42.841259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:42.850795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1291/2564] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:43.170381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:43.172010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:43.185255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8f83-9f7a-4b5c-a1a0-a06ad8a47b61 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:43.189804 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:43.190469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:43.190744 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:43.191018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] PATH_INFO: `/v3/projects/2cac450636194dfc8ab7d810a2a14ede` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:43.192136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cac450636194dfc8ab7d810a2a14ede)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:43.194134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:43.241088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cac450636194dfc8ab7d810a2a14ede', 'request_id': 'req-2a6e2c46-aaa6-4008-a1be-6594163ac687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.247625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cac450636194dfc8ab7d810a2a14ede', 'request_id': 'req-2a6e2c46-aaa6-4008-a1be-6594163ac687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.253526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cac450636194dfc8ab7d810a2a14ede', 'request_id': 'req-2a6e2c46-aaa6-4008-a1be-6594163ac687'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.266016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] The token cache is being invalidate because project 2cac450636194dfc8ab7d810a2a14ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:43.266296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.266907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.268434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1274/2565] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:43 2022] DELETE /identity/v3/projects/2cac450636194dfc8ab7d810a2a14ede => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:43.272398 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:43.282905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6863ae-ebc5-4750-984c-41b76eff96be service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:43.296023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:43.343571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:43.344201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:43.344480 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:43.344750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] PATH_INFO: `/v3/users/997741dad62c4f1b87493b12baf7656b` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:43.345865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=997741dad62c4f1b87493b12baf7656b)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:43.347793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:43.394610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '997741dad62c4f1b87493b12baf7656b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.395264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '997741dad62c4f1b87493b12baf7656b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.395917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '997741dad62c4f1b87493b12baf7656b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.403503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '997741dad62c4f1b87493b12baf7656b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.411163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9788cee5-27fc-4ced-aa34-91a34a89ec47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '997741dad62c4f1b87493b12baf7656b'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.428269 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1292/2566] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:43 2022] DELETE /identity/v3/users/997741dad62c4f1b87493b12baf7656b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:43.702887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:43.704709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:43.720983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6e2c46-aaa6-4008-a1be-6594163ac687 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:43.780854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:43.781602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:43.781940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:43.782136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] PATH_INFO: `/v3/projects/600a2d50c487429988e4f7e9f22fdfa8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:43.783250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=600a2d50c487429988e4f7e9f22fdfa8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:43.786410 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:43.809368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:43.837865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600a2d50c487429988e4f7e9f22fdfa8', 'request_id': 'req-31948297-60bb-40a9-8649-e5bfe186f4ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.843984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600a2d50c487429988e4f7e9f22fdfa8', 'request_id': 'req-31948297-60bb-40a9-8649-e5bfe186f4ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.849475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600a2d50c487429988e4f7e9f22fdfa8', 'request_id': 'req-31948297-60bb-40a9-8649-e5bfe186f4ae'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.862002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] The token cache is being invalidate because project 600a2d50c487429988e4f7e9f22fdfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:43.862291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.862909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-31948297-60bb-40a9-8649-e5bfe186f4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:43.864452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1275/2567] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:43 2022] DELETE /identity/v3/projects/600a2d50c487429988e4f7e9f22fdfa8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:43.869229 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:43.869754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:43.869754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:43.890942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:43.892171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:43.949743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1293/2568] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:43.957440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:43.957728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:43.958006 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:43.977834 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:43.979040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:43.987292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1276/2569] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:43.991700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.002036 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fb2de-0316-4872-9190-78d6591765d4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.006688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.007275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.007581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.007850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.008481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:44.008780 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.010347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.024187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1294/2570] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:44.028769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.038231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81910885-4ada-43c4-8c61-1ff3d372aa44 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.043033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.043671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.043946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.044216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.044832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.046694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.074592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1277/2571] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:44 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:44.078720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.089045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5533e-efa8-412b-8ea4-72f423a5fcc9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.109549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:44.149595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.150199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.150479 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.150815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.151619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.153434 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.175525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1295/2572] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:44 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:02:44.179894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.191368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fd01-e0d7-4a70-9850-3ab08df091d3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.196116 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.196720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.197000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.197274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.197918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.200141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.211409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1278/2573] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:02:44.215411 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.225814 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0c15f-f85e-4d64-8ead-bf47fcaebabb admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.230476 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.231069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.231345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.231652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.232295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.233885 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab496d-a879-4257-8c86-a5ba5d1857ff admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.244014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1296/2574] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:44.248717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.258705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67308ec-5dce-42b2-9c9d-40725402e372 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.264281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.264812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.265093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.265369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] PATH_INFO: `/v3/projects/1b90cab017604d4fb60ac685ed9bd136/users/8b175fa14b3a4660a9446f00b78f0650/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.281901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b90cab017604d4fb60ac685ed9bd136, user_id=8b175fa14b3a4660a9446f00b78f0650, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.284830 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.297989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1279/2575] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:44 2022] PUT /identity/v3/projects/1b90cab017604d4fb60ac685ed9bd136/users/8b175fa14b3a4660a9446f00b78f0650/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:44.309539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbce22-0eac-4f06-8c1b-c2d11b4aa52b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.309827 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbce22-0eac-4f06-8c1b-c2d11b4aa52b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.310102 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bbce22-0eac-4f06-8c1b-c2d11b4aa52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.337530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e5bbce22-0eac-4f06-8c1b-c2d11b4aa52b None None] MFA Rules not processed for user `8b175fa14b3a4660a9446f00b78f0650`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:44.339324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e5bbce22-0eac-4f06-8c1b-c2d11b4aa52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:44.406589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1297/2576] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:44.417758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:44.419452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:44.478765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afbf07-1a2e-4eee-931f-dec55d4563c8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:44.482743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:44.483344 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.483654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.483922 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:44.492315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:44.493731 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:44.503182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1280/2577] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:44.982860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:44.983367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:44.983700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:45.022157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:45.023405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:45.086175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1298/2578] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 05:02:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:45.133255 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:45.134701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:45.186421 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:45.210032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2df7-2c25-46f4-b379-5390c0a50900 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:45.215629 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:45.216231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:45.216512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:45.216786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:45.225222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:45.226738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4a3d5-bf4d-4a4e-8bce-8812ac495fa4 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:45.235543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1281/2579] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:02:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:02:50.076228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:50.103298 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:50.162804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9bcfd-804f-4044-9540-aef55dc357b1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:50.168562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:50.169425 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:50.169784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:50.170168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] PATH_INFO: `/v3/users/8b175fa14b3a4660a9446f00b78f0650` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:50.171338 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b175fa14b3a4660a9446f00b78f0650)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:50.173466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:50.240912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b175fa14b3a4660a9446f00b78f0650'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.241689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b175fa14b3a4660a9446f00b78f0650'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.242368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b175fa14b3a4660a9446f00b78f0650'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.253315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b175fa14b3a4660a9446f00b78f0650'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.268210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b175fa14b3a4660a9446f00b78f0650'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.296107 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1299/2580] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:50 2022] DELETE /identity/v3/users/8b175fa14b3a4660a9446f00b78f0650 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:50.300256 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:50.300725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:50.301004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:50.325612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:50.327024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:50.436230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1282/2581] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:50.446169 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:50.447818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:50.524303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43aef0-deb3-4581-94f2-56953228833f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:50.529026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:50.530110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:50.530408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:50.530673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:50.543532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:50.543972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11151f6e-53c0-4ede-822a-8dbd847ff622 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:50.555876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1300/2582] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:50.882874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:50.884158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:50.903883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbed10-a8a3-4d07-81ec-4db0d346131a None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:50.912484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:50.913137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:50.913471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:50.913748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] PATH_INFO: `/v3/projects/1b90cab017604d4fb60ac685ed9bd136` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:50.914924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b90cab017604d4fb60ac685ed9bd136)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:50.917568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:50.979742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b90cab017604d4fb60ac685ed9bd136', 'request_id': 'req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.986963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b90cab017604d4fb60ac685ed9bd136', 'request_id': 'req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:50.995574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b90cab017604d4fb60ac685ed9bd136', 'request_id': 'req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:51.014359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] The token cache is being invalidate because project 1b90cab017604d4fb60ac685ed9bd136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:51.014794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:51.016210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-742b6a7d-5b0b-4948-80bb-e3e3c758c03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:51.017814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1283/2583] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:50 2022] DELETE /identity/v3/projects/1b90cab017604d4fb60ac685ed9bd136 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:51.023686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.024038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.024754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.047580 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:51.048755 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:51.093460 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:51.126705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1301/2584] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:51.128469 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.129079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.129534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.153470 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:51.154725 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:51.164843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1284/2585] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:02:51.169160 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.180129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d348-2a90-4a8a-8918-699b50e9f3eb None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.185719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.186335 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.186660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.186932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.187614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:51.187919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.190493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.203800 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1302/2586] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:51.208161 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.217900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c160cc4b-1552-4522-85bb-64e0d6d07b39 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.222772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.223429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.223733 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.224007 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.224769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.226655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.261399 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1285/2587] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:51.263022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.274510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277156-39b3-4ba2-84ce-37ca78180c00 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.354794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.355983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.356266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.356568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.357213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.359154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.395506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1303/2588] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:51 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:51.399519 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.413290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb60105-80da-43c4-8e15-1b7f37099593 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.428209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.429107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.429509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.429915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.430574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.432793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.446836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1286/2589] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:51.451154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.461764 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e7b17-c05d-43de-8018-3b601100d49f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.466648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.467268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.467588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.467864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.468512 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.470112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe118c-bdbc-4433-86b2-3a0e98c2cc2f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.487129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.488135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1304/2590] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:51.500553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff41da-1b02-42d8-9b30-5b1f198c151d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.506011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.506669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.506949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.507416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] PATH_INFO: `/v3/projects/a99231739cba48a89f92fb010848a4d9/users/df83b4658c194f94914f4c02195e4479/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.527463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99231739cba48a89f92fb010848a4d9, user_id=df83b4658c194f94914f4c02195e4479, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.530222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.534226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:51.555882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1287/2591] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:51 2022] PUT /identity/v3/projects/a99231739cba48a89f92fb010848a4d9/users/df83b4658c194f94914f4c02195e4479/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:02:51.562992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.563231 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.563532 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.603792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] MFA Rules not processed for user `df83b4658c194f94914f4c02195e4479`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:51.605534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:51.688521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1305/2592] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:51.700412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:51.702697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:51.797155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3653207-4528-408b-9d4d-e856717225bc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:51.801278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:51.801891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:51.802172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:51.802451 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:51.812162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:51.813597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948af10a-9e16-4365-a415-dc528ce51d1e service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:51.826136 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1288/2593] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:54.451669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:54.496008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:54.519437 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374356a6-b87d-4294-bdf9-dad33b7e2a34 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:54.524025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:54.524594 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:54.524872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:54.525141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] PATH_INFO: `/v3/users/df83b4658c194f94914f4c02195e4479` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:54.526358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df83b4658c194f94914f4c02195e4479)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:54.528351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:54.574405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df83b4658c194f94914f4c02195e4479'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:54.575048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df83b4658c194f94914f4c02195e4479'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:54.575675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df83b4658c194f94914f4c02195e4479'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:54.582586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df83b4658c194f94914f4c02195e4479'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:54.590081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df83b4658c194f94914f4c02195e4479'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:54.607568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1306/2594] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:02:54 2022] DELETE /identity/v3/users/df83b4658c194f94914f4c02195e4479 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:54.612046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:54.612539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:54.612639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:54.631803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:54.633000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:54.691883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1289/2595] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:54.702467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:54.703924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:54.762117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c560b79-3cc7-47de-86bf-0d52b720843b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:54.765772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:54.766376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:54.766654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:54.766925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:54.776088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:54.777430 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ae6b5-80eb-4571-ac99-da112a415411 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:54.786984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1307/2596] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:55.052761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.054304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:55.087671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf73f2-bc34-4219-9ca9-c70e473a601f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.098434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.099084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.099363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.099670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] PATH_INFO: `/v3/projects/a99231739cba48a89f92fb010848a4d9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.101030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99231739cba48a89f92fb010848a4d9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.103176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.155035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99231739cba48a89f92fb010848a4d9', 'request_id': 'req-94065bd3-f5ad-474f-bf22-b88868a3a085'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:55.161674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99231739cba48a89f92fb010848a4d9', 'request_id': 'req-94065bd3-f5ad-474f-bf22-b88868a3a085'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:55.168556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99231739cba48a89f92fb010848a4d9', 'request_id': 'req-94065bd3-f5ad-474f-bf22-b88868a3a085'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:55.183398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] The token cache is being invalidate because project a99231739cba48a89f92fb010848a4d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:02:55.183762 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:55.184397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-94065bd3-f5ad-474f-bf22-b88868a3a085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:02:55.186092 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1290/2597] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:02:55 2022] DELETE /identity/v3/projects/a99231739cba48a89f92fb010848a4d9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:55.190985 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.191526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.191872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.212377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:55.213733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:55.277301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1308/2598] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:55.286521 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.286808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.287153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.307498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:55.308794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:55.316938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1291/2599] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:55.321301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.327034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:55.340248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bac084-3584-444c-b991-6b68a2f4ac3c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.345324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.346069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.346462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.346743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.347417 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:02:55.347753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.349361 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.364947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1309/2600] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:02:55.366130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.376170 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0094e-a4b2-4f31-b658-20bff17fab5c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.380890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.381485 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.381764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.382036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.382655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.384585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.399986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:55.419264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1292/2601] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:02:55 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:55.420496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.431234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a1947-c690-46e1-8242-b08a3062d247 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.502453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.503192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.503334 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.503634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.504261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.506157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.528741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1310/2602] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:02:55 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:02:55.533062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.544757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b605f-144d-4b25-8303-36e550c6f967 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.549397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.549997 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.550277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.550551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.551189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.552813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.567326 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1293/2603] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:55.568750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.579197 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459834ff-f62a-4cec-a375-b79fc74d916f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.584322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.584945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.585226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.585500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.586145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.587912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b7435-c767-47ed-8edf-bab9b1a303b4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.598265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1311/2604] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:02:55.602734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.613651 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47077a-2a2d-4fde-b197-38470a18b57c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.618379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.619048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.619946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.620388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] PATH_INFO: `/v3/projects/c75295a279d54f889f5527348af48497/users/82e512ab6ef648c185f6a625420e12bd/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.635738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c75295a279d54f889f5527348af48497, user_id=82e512ab6ef648c185f6a625420e12bd, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.638359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.653036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1294/2605] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:02:55 2022] PUT /identity/v3/projects/c75295a279d54f889f5527348af48497/users/82e512ab6ef648c185f6a625420e12bd/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:02:55.663155 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc8e5-012f-4c36-9b88-9c41b067670f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.663441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc8e5-012f-4c36-9b88-9c41b067670f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.663738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efc8e5-012f-4c36-9b88-9c41b067670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.693454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-21efc8e5-012f-4c36-9b88-9c41b067670f None None] MFA Rules not processed for user `82e512ab6ef648c185f6a625420e12bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:55.694668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-21efc8e5-012f-4c36-9b88-9c41b067670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:55.761151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1312/2606] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:02:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:55.772590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:55.774447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:55.833447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e0fea-7653-4270-901d-7e6f2f3a643f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:55.836989 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:55.837589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:55.837869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:55.838273 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:55.846486 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:55.847950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedaf3ad-2723-4782-bab4-a93a98ec2c29 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:55.856711 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1295/2607] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:59.386230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.386765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.386861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.388168 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1313/2608] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:02:59.394897 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb6a7-fabe-493b-baa2-106fef437944 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.395366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb6a7-fabe-493b-baa2-106fef437944 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.395520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cb6a7-fabe-493b-baa2-106fef437944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.427861 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-712cb6a7-fabe-493b-baa2-106fef437944 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:59.429086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-712cb6a7-fabe-493b-baa2-106fef437944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.512391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1296/2609] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:02:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:59.524925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:59.527424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.585192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213cadb-7c5e-460a-ad65-ba98ed0a1b48 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:59.589255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:59.589848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.590127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.590397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.600486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:59.601901 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534734d4-1f0d-4131-85bd-30038cbfbfa7 service glance] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:59.608362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:02:59.613713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1314/2610] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:02:59.680447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.680737 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.681018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] PATH_INFO: `/` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.682381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1297/2611] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 05:02:59.687096 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a6d-67ff-4631-923d-6b54fc0414b3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.687375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a6d-67ff-4631-923d-6b54fc0414b3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.687676 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c12a6d-67ff-4631-923d-6b54fc0414b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.707121 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e4c12a6d-67ff-4631-923d-6b54fc0414b3 None None] MFA Rules not processed for user `8753ed696f8d4cffb71475a945778e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:59.708351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e4c12a6d-67ff-4631-923d-6b54fc0414b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.757628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1315/2612] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:02:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:59.769569 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:59.771310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.785487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8dc48-dccb-4503-b7fb-a29df43cd82e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:59.788974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:59.789589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.789869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.790137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.797159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:59.798560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235487-b808-452c-9f05-bb38ed9c152a service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:59.806235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1298/2613] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:02:59.889062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.889344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.889611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.890993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1316/2614] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:02:59.895859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaee2b-fcbc-4553-b83a-9cd13f3323e9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.896146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaee2b-fcbc-4553-b83a-9cd13f3323e9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.896424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaee2b-fcbc-4553-b83a-9cd13f3323e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.916476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-67aaee2b-fcbc-4553-b83a-9cd13f3323e9 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:02:59.917926 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-67aaee2b-fcbc-4553-b83a-9cd13f3323e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.927216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1299/2615] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:02:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:02:59.938147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:02:59.939887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:02:59.953554 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3addf-a52b-49ca-9080-8ee2224d083c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:02:59.957248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:02:59.957911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:02:59.958278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:02:59.958608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:02:59.969081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:02:59.970595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:02:59.982100 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1317/2616] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:02:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:02.122051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253111e8-1bd9-4910-9439-d26bb9992f9d None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:02.122498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253111e8-1bd9-4910-9439-d26bb9992f9d None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:02.122610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253111e8-1bd9-4910-9439-d26bb9992f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:02.142476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-253111e8-1bd9-4910-9439-d26bb9992f9d None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:02.143704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-253111e8-1bd9-4910-9439-d26bb9992f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:02.154604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:02.210672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1300/2617] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 05:03:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:02.223044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:02.224454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:02.292817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf40f-47f4-4aa5-9f0c-107951af52c1 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:02.297749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:02.298341 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:02.298617 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:02.298889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:02.306967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:02.308579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:02.316614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1318/2618] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:03:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:12.203628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=19 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:12.313511 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=61 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:26.761376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:26.762184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:26.762184 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:26.785400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:26.786705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:26.796347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1301/2619] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 05:03:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:26.811662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:26.825955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6e1f4-2295-48b0-a675-d4273fb38c92 service swift] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:26.831598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:26.832200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:26.832477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:26.832744 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:26.841624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:26.843207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1d601-ae56-4bc4-aa41-14aa648c34af service swift] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:26.852462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1319/2620] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:03:31.315068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:31.376446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422dea2-ffba-424a-8be5-627a67790830 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:31.381719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:31.382345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:31.382627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:31.382901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] PATH_INFO: `/v3/users/82e512ab6ef648c185f6a625420e12bd` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:31.384063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] RBAC: Authorizing `identity:delete_user(user_id=82e512ab6ef648c185f6a625420e12bd)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:31.385961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:31.431586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82e512ab6ef648c185f6a625420e12bd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.432234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82e512ab6ef648c185f6a625420e12bd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.439732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82e512ab6ef648c185f6a625420e12bd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.440362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82e512ab6ef648c185f6a625420e12bd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.448096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82e512ab6ef648c185f6a625420e12bd'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.465209 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1302/2621] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:03:31 2022] DELETE /identity/v3/users/82e512ab6ef648c185f6a625420e12bd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:31.469637 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:31.470101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:31.470207 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:31.490419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:03:31.491743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:31.549860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1320/2622] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:03:31.560048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:31.561491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:31.620284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364fd1c-735d-46e7-8a61-cc6dc0d4b42a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:31.624110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:31.624748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:31.625027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:31.625296 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:31.634390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:31.635845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:31.645127 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1303/2623] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:31.915493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:31.917048 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:31.931660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a56efc-3ec0-42db-8bef-9b32d603cb3c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:31.936927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:31.937573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:31.937853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:31.938131 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] PATH_INFO: `/v3/projects/c75295a279d54f889f5527348af48497` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:31.939300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c75295a279d54f889f5527348af48497)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:31.941406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:31.989167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c75295a279d54f889f5527348af48497', 'request_id': 'req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:31.994870 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c75295a279d54f889f5527348af48497', 'request_id': 'req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.002211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c75295a279d54f889f5527348af48497', 'request_id': 'req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.013333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] The token cache is being invalidate because project c75295a279d54f889f5527348af48497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:03:32.013636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.014248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:03:32.015769 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1321/2624] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:03:31 2022] DELETE /identity/v3/projects/c75295a279d54f889f5527348af48497 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:03:41.641082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:42.010315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:03:51.320534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:51.322053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:51.380823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e7ca5-99e4-4d9f-adfd-564de149eecc service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:51.429903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:51.430506 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:51.430812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:51.431082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:51.433590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:51.504680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:51.506172 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:51.518260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1304/2625] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:03:59.126653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:03:59.128193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:59.190818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a6535c-7ddb-4123-a56a-87d246e3ea0d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:03:59.194448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:03:59.195056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:03:59.195354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:03:59.195654 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:03:59.197374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:03:59.280483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:03:59.281938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:03:59.301492 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1322/2626] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:03:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:01.513265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=74 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:03.808512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:03.810447 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:03.822329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0d852-07a9-4542-8bef-c452f46d99a5 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:03.826850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:03.827463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:03.827763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:03.828032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:03.829772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:03.896048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:03.897465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:03.908346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1305/2627] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:06.811445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:06.813234 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:06.829752 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74383a6-8a95-43a2-9782-952b8d742617 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:06.834290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:06.834917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:06.835190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:06.835457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] PATH_INFO: `/v3/users/5eadf34dc91e4dd79d00a9e218117032` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:06.836598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eadf34dc91e4dd79d00a9e218117032)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:06.838517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:06.887118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eadf34dc91e4dd79d00a9e218117032'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:06.887798 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eadf34dc91e4dd79d00a9e218117032'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:06.888418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eadf34dc91e4dd79d00a9e218117032'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:06.896433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eadf34dc91e4dd79d00a9e218117032'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:06.903638 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-c23341e0-28a1-400d-a8c8-e0ff0cdc3978 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eadf34dc91e4dd79d00a9e218117032'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:06.917000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:06.923397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1323/2628] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:06 2022] DELETE /identity/v3/users/5eadf34dc91e4dd79d00a9e218117032 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:07.099911 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.112062 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc570acd-bd8a-41ca-a4d0-9a6b7defb515 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.178810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.179442 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.179756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.180027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] PATH_INFO: `/v3/projects/6846942f10c44767ac61480891df2a0e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.181132 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6846942f10c44767ac61480891df2a0e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.183039 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.227670 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6846942f10c44767ac61480891df2a0e', 'request_id': 'req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:07.234340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6846942f10c44767ac61480891df2a0e', 'request_id': 'req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:07.239881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6846942f10c44767ac61480891df2a0e', 'request_id': 'req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:07.251899 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] The token cache is being invalidate because project 6846942f10c44767ac61480891df2a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:07.252185 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:07.252806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0e08668a-7aa6-4346-a2aa-3b2189dda7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:07.254309 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1306/2629] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:07 2022] DELETE /identity/v3/projects/6846942f10c44767ac61480891df2a0e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:07.259344 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.259662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.259932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.279534 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:07.281879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:07.343950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1324/2630] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:07.352574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.352882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.353164 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.373207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:07.374424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:07.382588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1307/2631] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:07.386754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.397046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af4d6-34e1-4fb1-8bfe-93f5b5c2696d None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.401675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.402270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.402549 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.402825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.403464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:07.403799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.406041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.418415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1325/2632] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:07.424717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.436253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e25f639-e308-4e7a-9274-497be9412de9 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.441260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.441969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.442250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.442524 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.443147 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.445089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.461756 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:07.485174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1308/2633] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:07 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:07.489216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.500266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01463e43-82f8-427b-a1b8-303fe10184df admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.560670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.561313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.561611 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.562609 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.563705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.566046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.591370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1326/2634] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:07 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:07.592445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.602964 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca981b5b-bcd5-4b43-8cb2-fb42ea979861 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.607648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.608314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.609330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.609730 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.610453 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.612261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.622824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1309/2635] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:07.627700 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.637748 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a61b4-aecc-42c0-a283-5cddf3a05362 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.642474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.643075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.643359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.643665 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.644301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.646762 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b907a3-0730-433e-9b9f-f16958be23b3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.658640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1327/2636] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:07.663231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.674282 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d2b71-3f43-4769-91d0-fb2d4b29c606 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.678915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.679592 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.679874 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.680146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] PATH_INFO: `/v3/projects/c1f9134e7643489d946f6d498ab48ccf/users/ab68d2adab234f439e825e1515a3bedd/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.695440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f9134e7643489d946f6d498ab48ccf, user_id=ab68d2adab234f439e825e1515a3bedd, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.698079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.710479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1310/2637] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:07 2022] PUT /identity/v3/projects/c1f9134e7643489d946f6d498ab48ccf/users/ab68d2adab234f439e825e1515a3bedd/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:07.720607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.720890 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.721163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.748924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] MFA Rules not processed for user `ab68d2adab234f439e825e1515a3bedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:07.750929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:07.805577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:07.816649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1328/2638] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:07.828199 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:07.829898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:07.903215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772681-88c3-428b-83eb-0bfc8e294dab admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:07.909647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:07.910243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:07.910526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:07.910792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:07.918688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:07.920293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd73276-9beb-4f8d-a385-845e57debf57 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:07.929776 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1311/2639] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:10.599040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:10.661255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36988645-76ae-4f59-a8b8-7558712fda72 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:10.665811 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:10.666472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:10.666750 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:10.667026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] PATH_INFO: `/v3/users/ab68d2adab234f439e825e1515a3bedd` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:10.668561 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab68d2adab234f439e825e1515a3bedd)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:10.670483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:10.718125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab68d2adab234f439e825e1515a3bedd'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:10.718792 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab68d2adab234f439e825e1515a3bedd'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:10.719988 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab68d2adab234f439e825e1515a3bedd'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:10.726963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab68d2adab234f439e825e1515a3bedd'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:10.735945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab68d2adab234f439e825e1515a3bedd'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:10.754061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1329/2640] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:10 2022] DELETE /identity/v3/users/ab68d2adab234f439e825e1515a3bedd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:10.758531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:10.759013 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:10.759133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:10.778502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:10.779562 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:10.837474 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1312/2641] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:04:10.847818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:10.849270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:10.907172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f3304-6128-472b-b385-ef3417b98904 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:10.910851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:10.911456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:10.911758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:10.912029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:10.921186 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:10.923198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1396f22-5a4e-4f6d-91fa-c806581810da service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:10.932533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1330/2642] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:11.203573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.205004 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:11.219272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e344b3-aeb3-4715-8ee1-c9fd9d9ae53e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.224045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.224858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.225049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.225259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] PATH_INFO: `/v3/projects/c1f9134e7643489d946f6d498ab48ccf` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.226440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f9134e7643489d946f6d498ab48ccf)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.228297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.264657 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:11.278531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f9134e7643489d946f6d498ab48ccf', 'request_id': 'req-72411c1b-660c-493e-9f34-ca8099c4e18b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:11.285128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f9134e7643489d946f6d498ab48ccf', 'request_id': 'req-72411c1b-660c-493e-9f34-ca8099c4e18b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:11.290745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f9134e7643489d946f6d498ab48ccf', 'request_id': 'req-72411c1b-660c-493e-9f34-ca8099c4e18b'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:11.303457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] The token cache is being invalidate because project c1f9134e7643489d946f6d498ab48ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:11.303802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:11.304385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-72411c1b-660c-493e-9f34-ca8099c4e18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:11.305857 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1313/2643] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:11 2022] DELETE /identity/v3/projects/c1f9134e7643489d946f6d498ab48ccf => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:11.310794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.311083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.311362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.331266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:11.332579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:11.342199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:11.394289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1331/2644] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:11.402271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.402555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.402844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.423881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:11.425087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:11.433171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1314/2645] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:11.437286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.447692 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52403164-5a99-46b4-a29c-d6e53086036f None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.456904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.457522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.457801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.458072 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.458719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:11.459024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.460669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.472970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1332/2646] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:11.477246 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.487259 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ed2ad-db15-410b-af7e-54a0370acb57 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.491962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.492557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.492836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.493111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.493736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.495660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.522011 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1315/2647] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:11.526154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.536806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d1d8b-664d-41fd-aa88-7ca9283d3ea4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.593738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.594879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.595277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.595595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.596211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.598106 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.618526 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1333/2648] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:11.622639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.633300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa35b3-8841-4cbb-bd87-9be64bd0d30a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.637907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.638500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.638777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.639048 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.639721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.641301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.651626 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1316/2649] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:11.655732 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.666203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05872a1-a562-497f-800b-341e8655101b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.671329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.671970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.672250 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.673266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.673947 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.675576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07abdc7-bce6-42f3-9ff9-8651df825699 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.686032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1334/2650] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:11.690468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.700311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec57cbf-23b5-4fcb-966a-2fa5fd07b452 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.704838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.705620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.705894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.706168 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] PATH_INFO: `/v3/projects/f790916316ef420c86848ffe8e739409/users/f6d6d2d4e21a44ce96622b6b5fd0ba60/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.721583 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790916316ef420c86848ffe8e739409, user_id=f6d6d2d4e21a44ce96622b6b5fd0ba60, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.724480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.737430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1317/2651] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:11 2022] PUT /identity/v3/projects/f790916316ef420c86848ffe8e739409/users/f6d6d2d4e21a44ce96622b6b5fd0ba60/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:11.749022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.749333 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.749608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.777847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] MFA Rules not processed for user `f6d6d2d4e21a44ce96622b6b5fd0ba60`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:11.779088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:11.843959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1335/2652] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:11.848504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.909402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a0f42-4c59-4714-8ebe-ae6b81e6f8c5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.914123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:11.914721 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:11.915002 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:11.915274 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:11.915931 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:11.917821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:11.945031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1318/2653] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:11.949362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:11.960030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12fe8cf-25a4-4d01-8d42-e6a419a394f5 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:11.967640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:12.017756 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.018365 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.018648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.018922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.019577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.021489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.041797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1336/2654] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:11 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:12.046027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.056831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e949e1-0353-42ad-8164-b32e1cbc1a68 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.061484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.062084 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.062363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.062640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.063905 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.065643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.076078 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1319/2655] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:12.080281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.090280 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae921f-41c5-4d30-87ec-ecdecd305041 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.095310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.095931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.096213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.096487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] PATH_INFO: `/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e/users/ea4fc199c5704c6b869fae45da1f705d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.112144 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=683dc1da2cc74570aab7e0ef133e0e3e, user_id=ea4fc199c5704c6b869fae45da1f705d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.114784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.129022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1337/2656] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:12 2022] PUT /identity/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e/users/ea4fc199c5704c6b869fae45da1f705d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:12.132939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.142939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261f251-dc94-42b6-ab89-48942c3b7ccd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.170635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:12.201803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.202403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.202686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.202961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.203633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.205299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9402b9a0-3d40-465b-9382-eacf8b9824bb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.215921 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1320/2657] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:12.220766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.230875 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73871fe4-a376-4fe1-8ffd-4ee03890f3d7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.236198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.236840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.237105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.237373 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] PATH_INFO: `/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e/users/ea4fc199c5704c6b869fae45da1f705d/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.239277 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=683dc1da2cc74570aab7e0ef133e0e3e, user_id=ea4fc199c5704c6b869fae45da1f705d, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.241916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.252199 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1338/2658] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:12 2022] PUT /identity/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e/users/ea4fc199c5704c6b869fae45da1f705d/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:12.262244 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.262531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.262822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.290928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] MFA Rules not processed for user `ea4fc199c5704c6b869fae45da1f705d`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:12.292174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:12.358814 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1321/2659] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:12.370568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.372382 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:12.431651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab35fb-17af-4f22-9030-b38a5f053e5e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.435271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.435893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.436176 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.436448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.446021 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.447495 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.457799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1339/2660] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:12.504046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:12.505511 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:12.519049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39811b-cf18-443c-b5a6-c38bb35de93e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:12.522589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:12.523178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:12.523450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:12.523749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:12.581728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:12.583183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d9da2-fb47-412f-a207-b2a1b84c9005 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:12.592044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1322/2661] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:15.859679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:15.922371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e973f-f3b7-4d73-b3f8-ebdca9ef3902 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:15.927190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:15.927844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:15.928122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:15.928394 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] PATH_INFO: `/v3/users/f6d6d2d4e21a44ce96622b6b5fd0ba60` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:15.929525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d6d2d4e21a44ce96622b6b5fd0ba60)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:15.931429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:15.936776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:15.977958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d6d2d4e21a44ce96622b6b5fd0ba60'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:15.978604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d6d2d4e21a44ce96622b6b5fd0ba60'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:15.979203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d6d2d4e21a44ce96622b6b5fd0ba60'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:15.986270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d6d2d4e21a44ce96622b6b5fd0ba60'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:15.994603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d6d2d4e21a44ce96622b6b5fd0ba60'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.012535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1340/2662] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:15 2022] DELETE /identity/v3/users/f6d6d2d4e21a44ce96622b6b5fd0ba60 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:16.017708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:16.018202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:16.018381 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:16.038215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:16.039417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:16.083761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=100 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:16.098824 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1323/2663] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:16.108741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:16.110141 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:16.167932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fac56d-69b9-43ff-86f7-579090e294e0 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:16.171896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:16.172493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:16.172773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:16.173044 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:16.182068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:16.183498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:16.193507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1341/2664] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:16.457680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:16.459115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:16.472660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e406b-e9af-4c62-bd18-8325ebc40229 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:16.477292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:16.477923 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:16.478207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:16.478482 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] PATH_INFO: `/v3/projects/f790916316ef420c86848ffe8e739409` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:16.479664 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f790916316ef420c86848ffe8e739409)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:16.482250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:16.530966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f790916316ef420c86848ffe8e739409', 'request_id': 'req-1ca15576-e691-4efc-8635-b642bc6a1a5d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.537887 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f790916316ef420c86848ffe8e739409', 'request_id': 'req-1ca15576-e691-4efc-8635-b642bc6a1a5d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.543443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f790916316ef420c86848ffe8e739409', 'request_id': 'req-1ca15576-e691-4efc-8635-b642bc6a1a5d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.555949 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] The token cache is being invalidate because project f790916316ef420c86848ffe8e739409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:16.556235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.556847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.558374 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1324/2665] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:16 2022] DELETE /identity/v3/projects/f790916316ef420c86848ffe8e739409 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:16.562374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:16.572688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08064248-ba58-4b85-9b28-cc41bed1130e service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:16.630368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:16.631039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:16.631261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:16.631555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] PATH_INFO: `/v3/users/ea4fc199c5704c6b869fae45da1f705d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:16.632656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea4fc199c5704c6b869fae45da1f705d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:16.634551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:16.670595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:16.686972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea4fc199c5704c6b869fae45da1f705d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.687718 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea4fc199c5704c6b869fae45da1f705d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.688419 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea4fc199c5704c6b869fae45da1f705d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.696275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea4fc199c5704c6b869fae45da1f705d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.705171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-da3cf59d-3cba-496e-98f5-70985ecd871a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea4fc199c5704c6b869fae45da1f705d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:16.723369 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1342/2666] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:16 2022] DELETE /identity/v3/users/ea4fc199c5704c6b869fae45da1f705d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:16.996900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:16.998339 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:17.014598 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca15576-e691-4efc-8635-b642bc6a1a5d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.075194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.075865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.076102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.076369 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] PATH_INFO: `/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.077464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=683dc1da2cc74570aab7e0ef133e0e3e)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.079333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.248578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683dc1da2cc74570aab7e0ef133e0e3e', 'request_id': 'req-0d2e2440-a03f-464d-88bb-4ad649326d4f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:17.255267 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683dc1da2cc74570aab7e0ef133e0e3e', 'request_id': 'req-0d2e2440-a03f-464d-88bb-4ad649326d4f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:17.261015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683dc1da2cc74570aab7e0ef133e0e3e', 'request_id': 'req-0d2e2440-a03f-464d-88bb-4ad649326d4f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:17.274074 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] The token cache is being invalidate because project 683dc1da2cc74570aab7e0ef133e0e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:17.274356 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:17.274970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0d2e2440-a03f-464d-88bb-4ad649326d4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:17.276535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1325/2667] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:16 2022] DELETE /identity/v3/projects/683dc1da2cc74570aab7e0ef133e0e3e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:17.281537 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.282014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.282122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.303030 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:17.304272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:17.365829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1343/2668] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:17.374842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.375124 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.375394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.384055 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:17.396477 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:17.397750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:17.405584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1326/2669] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:17.410523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.420451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d432cc-2bba-41e7-8441-4a729e2101c0 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.425213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.425805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.426078 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.426345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.426979 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:17.427276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.428886 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.440598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1344/2670] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:17.444760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.454040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50f4e1-9cd6-4a5a-a91e-4657b3fa77ad None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.459347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.459981 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.460258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.460534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.461163 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.463027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.493487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1327/2671] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:17.497669 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.508405 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618ba342-318b-4169-99fc-af4a38e0d9a8 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.565797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.566393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.566668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.566935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.567588 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.569473 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.589843 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1345/2672] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:04:17.594036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.605234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e0902-68ee-4d0f-aa9f-a5a1b3ecd1ba admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.609839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.610428 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.610705 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.611634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.612382 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.614020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.623760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1328/2673] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:17.627766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.637790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b709262-aa1d-4501-94a3-0cb2e02b8c53 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.642422 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.643171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.643451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.643751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.644383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.645967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5374131-dcea-4b68-9ea7-643e0ca3b2de admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.658993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1346/2674] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:17.663952 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.675851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47470849-31cd-4295-9a8a-7a2bc67b04d5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.680434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.681075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.681346 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.681612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] PATH_INFO: `/v3/projects/166e7b2545ff48009aa8108e5c0cc084/users/aa3b56a81f554b3c943be963273e8cb6/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.696465 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] RBAC: Authorizing `identity:create_grant(project_id=166e7b2545ff48009aa8108e5c0cc084, user_id=aa3b56a81f554b3c943be963273e8cb6, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.699101 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.712162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1329/2675] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:17 2022] PUT /identity/v3/projects/166e7b2545ff48009aa8108e5c0cc084/users/aa3b56a81f554b3c943be963273e8cb6/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:17.723765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f75b-6931-4141-8703-6aba534e798a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.724209 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f75b-6931-4141-8703-6aba534e798a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.724568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450f75b-6931-4141-8703-6aba534e798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.751024 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:17.754686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2450f75b-6931-4141-8703-6aba534e798a None None] MFA Rules not processed for user `aa3b56a81f554b3c943be963273e8cb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:17.756592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2450f75b-6931-4141-8703-6aba534e798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:17.824116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1347/2676] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:17.829207 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.893452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f59e2-1a75-470b-8524-f456c7f2affb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:17.898051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:17.898647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:17.898925 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:17.899197 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:17.899849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:17.901732 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:17.928745 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1330/2677] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:17.932808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450f75b-6931-4141-8703-6aba534e798a None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:17.944228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450f75b-6931-4141-8703-6aba534e798a None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.000501 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.001157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.001393 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.002264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.003037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.004998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.027118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1348/2678] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:17 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:18.031108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.041258 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785502a-d840-430c-a276-f16892dad6d2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.046118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.046710 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.046991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.047360 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.048033 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.050103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.059893 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1331/2679] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:18.063666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.074352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37b821-dc5a-492f-9eb7-b9aedb4f95c9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.078955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.079577 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.079854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.080125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.080904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.082462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9aaf73-a648-439f-bd68-93b279c0ade0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.092150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1349/2680] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:18.096249 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.106420 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57b4d-8536-4775-8b38-20a49ca3f7c0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.112668 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.113308 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.113580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.113848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] PATH_INFO: `/v3/projects/4d7c4d4d15054437a1cca3b70fbb9d22/users/68d26edcb3f24edea7fca5396fdd15a6/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.130075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7c4d4d15054437a1cca3b70fbb9d22, user_id=68d26edcb3f24edea7fca5396fdd15a6, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.132767 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.145768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1332/2681] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:18 2022] PUT /identity/v3/projects/4d7c4d4d15054437a1cca3b70fbb9d22/users/68d26edcb3f24edea7fca5396fdd15a6/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:18.155915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.156222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.156502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.184572 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] MFA Rules not processed for user `68d26edcb3f24edea7fca5396fdd15a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:18.185948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:18.250238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1350/2682] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:18.254693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.304130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:18.316086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2115-e49d-401a-bfb2-66bc77194dc8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.320625 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.321241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.321517 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.321784 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.322401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.324305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.350526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1333/2683] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:18 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:18.354613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.365871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfec2c-5276-4b40-890c-ff2e77b5f57a None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.373571 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:18.424474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.425077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.425354 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.425619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.426225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.428156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.447818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1351/2684] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:18 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:18.451898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.463493 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a67e06-234d-42fe-8274-c1b433ef8875 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.469960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.471176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.471450 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.473551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.477738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.480034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.494214 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1334/2685] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:18.498340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.509202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec1f4e-250a-4cbc-8249-7a6c78fb5f30 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.513754 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.514395 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.514666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.514932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] PATH_INFO: `/v3/projects/26ce5944f233468faac8e562cd33c1e2/users/8e8c711e7d2640189fbfd49564251cc4/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.529539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce5944f233468faac8e562cd33c1e2, user_id=8e8c711e7d2640189fbfd49564251cc4, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.532175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.546558 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1352/2686] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:18 2022] PUT /identity/v3/projects/26ce5944f233468faac8e562cd33c1e2/users/8e8c711e7d2640189fbfd49564251cc4/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:18.551284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.561424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a868f21-0c18-4727-bc8e-dfe4a4e713c9 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.617603 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.618227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.618501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.618769 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.619398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.620984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91d613-1580-4ec6-85cf-a1595ed61328 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.630892 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1335/2687] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:18.635037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.645806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c561f-8906-4e79-bc6f-23dbfe0b49a4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.650508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.651152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.651428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.651741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] PATH_INFO: `/v3/projects/26ce5944f233468faac8e562cd33c1e2/users/8e8c711e7d2640189fbfd49564251cc4/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.653657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ce5944f233468faac8e562cd33c1e2, user_id=8e8c711e7d2640189fbfd49564251cc4, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.656313 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.666967 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1353/2688] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:18 2022] PUT /identity/v3/projects/26ce5944f233468faac8e562cd33c1e2/users/8e8c711e7d2640189fbfd49564251cc4/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:18.678227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.678587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.678928 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.707299 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] MFA Rules not processed for user `8e8c711e7d2640189fbfd49564251cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:18.708529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:18.777090 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1336/2689] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:18 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:18.788888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:18.790675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:18.859823 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6815-ecbe-4ff7-9104-316fd51cc3b4 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:18.864149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:18.864753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:18.865032 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:18.865299 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:18.874378 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:18.875860 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:18.885889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1354/2690] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:18 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:19.387235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:19.388635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:19.400878 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f7b20-29f7-4b24-ac77-352129df5417 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:19.404359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:19.404940 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:19.405213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:19.405479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:19.448502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:19.463144 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:19.464604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:19.474277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1337/2691] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:23.500347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:23.509969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ed1a7-24b6-463a-ab3f-5457b42665d6 service cinder] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:23.513720 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:23.514267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:23.514541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:23.514808 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:23.577061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:23.578484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ace852d-bf10-4ea3-8c83-345d60a14797 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:23.587995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1355/2692] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:25.659633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:25.721845 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809097ed-9e31-422d-82aa-da88f649a9ca service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:25.726828 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:25.727446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:25.727758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:25.728027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] PATH_INFO: `/v3/users/aa3b56a81f554b3c943be963273e8cb6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:25.729150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3b56a81f554b3c943be963273e8cb6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:25.731040 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:25.776056 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3b56a81f554b3c943be963273e8cb6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:25.776692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3b56a81f554b3c943be963273e8cb6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:25.783821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3b56a81f554b3c943be963273e8cb6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:25.784445 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3b56a81f554b3c943be963273e8cb6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:25.792464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3b56a81f554b3c943be963273e8cb6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:25.810475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1338/2693] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:25 2022] DELETE /identity/v3/users/aa3b56a81f554b3c943be963273e8cb6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:04:25.814976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a077-64a9-4298-980d-bd49820887df None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:25.815440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a077-64a9-4298-980d-bd49820887df None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:25.815562 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24a077-64a9-4298-980d-bd49820887df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:25.823639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:25.835043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0c24a077-64a9-4298-980d-bd49820887df None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:25.836294 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0c24a077-64a9-4298-980d-bd49820887df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:25.895598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1356/2694] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:04:25.905158 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:25.906597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:25.963877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd108ada-6576-487f-901f-46f1d49e1a54 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:25.967409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:25.968045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:25.968322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:25.968588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:25.978149 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:25.979618 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:25.988980 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1339/2695] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:26.253388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a077-64a9-4298-980d-bd49820887df None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:26.255494 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0c24a077-64a9-4298-980d-bd49820887df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:26.271568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24a077-64a9-4298-980d-bd49820887df None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:26.276256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:26.276902 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:26.277184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:26.277468 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] PATH_INFO: `/v3/projects/166e7b2545ff48009aa8108e5c0cc084` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:26.278664 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] RBAC: Authorizing `identity:delete_project(project_id=166e7b2545ff48009aa8108e5c0cc084)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:26.280543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:26.329241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '166e7b2545ff48009aa8108e5c0cc084', 'request_id': 'req-b4feda35-62aa-4e15-bb86-9f1819e73efc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.334950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '166e7b2545ff48009aa8108e5c0cc084', 'request_id': 'req-b4feda35-62aa-4e15-bb86-9f1819e73efc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.342130 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '166e7b2545ff48009aa8108e5c0cc084', 'request_id': 'req-b4feda35-62aa-4e15-bb86-9f1819e73efc'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.353183 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] The token cache is being invalidate because project 166e7b2545ff48009aa8108e5c0cc084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:26.353467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.354088 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.355622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1357/2696] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:26 2022] DELETE /identity/v3/projects/166e7b2545ff48009aa8108e5c0cc084 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:26.359641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:26.370217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ba4c8-3dbf-4213-b965-ecfd146d7517 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:26.373913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:26.430211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:26.430891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:26.431121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:26.431394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] PATH_INFO: `/v3/users/68d26edcb3f24edea7fca5396fdd15a6` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:26.432548 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d26edcb3f24edea7fca5396fdd15a6)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:26.434434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:26.481166 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d26edcb3f24edea7fca5396fdd15a6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.481823 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d26edcb3f24edea7fca5396fdd15a6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.489612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d26edcb3f24edea7fca5396fdd15a6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.490277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d26edcb3f24edea7fca5396fdd15a6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.497512 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d26edcb3f24edea7fca5396fdd15a6'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.515032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1340/2697] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:26 2022] DELETE /identity/v3/users/68d26edcb3f24edea7fca5396fdd15a6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:26.790553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:26.792241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:26.811884 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4feda35-62aa-4e15-bb86-9f1819e73efc admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:26.876672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:26.877552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:26.877919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:26.878413 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] PATH_INFO: `/v3/projects/4d7c4d4d15054437a1cca3b70fbb9d22` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:26.880726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7c4d4d15054437a1cca3b70fbb9d22)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:26.883359 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:26.918257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:26.934161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7c4d4d15054437a1cca3b70fbb9d22', 'request_id': 'req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.941996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7c4d4d15054437a1cca3b70fbb9d22', 'request_id': 'req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.951878 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7c4d4d15054437a1cca3b70fbb9d22', 'request_id': 'req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.966273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] The token cache is being invalidate because project 4d7c4d4d15054437a1cca3b70fbb9d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:26.966486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.967167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:26.969009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1358/2698] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:26 2022] DELETE /identity/v3/projects/4d7c4d4d15054437a1cca3b70fbb9d22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:26.975394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:26.975963 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:26.995662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd23e83-b057-461f-989b-09d6f0f708cf admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.072221 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.072908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.073226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.073547 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] PATH_INFO: `/v3/users/8e8c711e7d2640189fbfd49564251cc4` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.075348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e8c711e7d2640189fbfd49564251cc4)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.078634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.108022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:27.129315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e8c711e7d2640189fbfd49564251cc4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.130579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e8c711e7d2640189fbfd49564251cc4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.138475 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e8c711e7d2640189fbfd49564251cc4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.139178 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e8c711e7d2640189fbfd49564251cc4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.147908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cf2c2615-2f28-438a-bdc1-3ef5f776c634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e8c711e7d2640189fbfd49564251cc4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.169388 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1341/2699] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:26 2022] DELETE /identity/v3/users/8e8c711e7d2640189fbfd49564251cc4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:27.486838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:27.488760 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:27.509190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de5058-8b0e-46ae-a38a-86bfdb2703d9 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.575904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.576462 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.576746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.577031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] PATH_INFO: `/v3/projects/26ce5944f233468faac8e562cd33c1e2` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.578181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ce5944f233468faac8e562cd33c1e2)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.580129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.627281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ce5944f233468faac8e562cd33c1e2', 'request_id': 'req-2c203443-675f-44a8-91d6-71b64ed8d677'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.633370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ce5944f233468faac8e562cd33c1e2', 'request_id': 'req-2c203443-675f-44a8-91d6-71b64ed8d677'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.640738 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ce5944f233468faac8e562cd33c1e2', 'request_id': 'req-2c203443-675f-44a8-91d6-71b64ed8d677'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.652493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] The token cache is being invalidate because project 26ce5944f233468faac8e562cd33c1e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:27.652871 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.653680 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2c203443-675f-44a8-91d6-71b64ed8d677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:27.655606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1359/2700] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:27 2022] DELETE /identity/v3/projects/26ce5944f233468faac8e562cd33c1e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:27.661780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.662065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.662349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.683210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:27.684540 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:27.744771 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1342/2701] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:27.753198 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.753487 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.753766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.773668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:27.774879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:27.782788 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1360/2702] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:27.787052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:27.796588 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36adc250-4f59-4e27-8435-6722b9cc7502 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.801261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.802633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.802910 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.803176 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.803844 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:27.804142 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.805704 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.816948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1343/2703] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:04:27.821776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:27.831084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e02ee-8f59-4e15-a1dd-f761dd26376c None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.836025 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.836614 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.836889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.837156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.837784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.839688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.867220 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1361/2704] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:27 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:27.871337 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:27.882098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99352d50-19f8-4b24-9c83-e4c9bb76a05e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.940066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.940666 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.940944 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.941219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.941833 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.944571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.964669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1344/2705] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:27 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:27.968749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:27.979426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de25f2-ca6d-4e52-ba6f-4cdd288a7516 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:27.983998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:27.984590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:27.984864 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:27.985134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:27.985770 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:27.987340 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:27.998297 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1362/2706] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:28.002115 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.012472 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bd8a-8534-428e-8594-4ea32f467029 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.017130 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.017748 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.018024 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.018294 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.018929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.020608 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b14990-2b5d-43d0-b17c-d9b801a4ab12 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.031438 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1345/2707] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:28.035765 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.046600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5733cff-a05c-4e00-aa7a-f4e6612fcbe2 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.051497 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.052838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.053152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.053427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] PATH_INFO: `/v3/projects/c44aa3f0716a489cb3343dfb56beeaa2/users/e00f5301a0a34f50b58b224c69c85102/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.056500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:28.070543 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c44aa3f0716a489cb3343dfb56beeaa2, user_id=e00f5301a0a34f50b58b224c69c85102, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.073213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.085560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1363/2708] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:28 2022] PUT /identity/v3/projects/c44aa3f0716a489cb3343dfb56beeaa2/users/e00f5301a0a34f50b58b224c69c85102/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:28.097818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.098110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.098385 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.119496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:28.127129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] MFA Rules not processed for user `e00f5301a0a34f50b58b224c69c85102`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:28.128783 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:28.194272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1346/2709] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:28.198735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.259371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216457d3-e510-450f-8ecb-1189411aad50 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.264011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.264606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.264881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.265151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.265775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.267743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.294946 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1364/2710] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:28 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:28.299793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.311095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82782ad6-29a0-4252-a0a9-9caa168e3bf2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.367094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.367659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.367942 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.368222 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.368847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.370778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.392777 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1347/2711] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:28 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:28.397426 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.407799 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1eb2-d419-4e1b-8b8d-dee0f73cc213 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.413351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.413949 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.414228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.414499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.415140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.416859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.428098 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1365/2712] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:28.432098 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.442216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8c7b4-a7b9-4805-9e5c-64c0b76dcd46 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.447051 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.447728 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.448005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.448300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] PATH_INFO: `/v3/projects/c54d9864adb749faa1d8c82665e1e537/users/5d82433b00414e3fba6e27c16691f988/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.463669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54d9864adb749faa1d8c82665e1e537, user_id=5d82433b00414e3fba6e27c16691f988, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.466250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.480064 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1348/2713] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:28 2022] PUT /identity/v3/projects/c54d9864adb749faa1d8c82665e1e537/users/5d82433b00414e3fba6e27c16691f988/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:28.484527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.494881 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a818d4-0320-41e1-b7e5-7bd5d4c7513b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.551996 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.552723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.553006 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.553282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.553919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.555541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cff0b36-bfe2-47d4-b49b-d76d31de061a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.565449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1366/2714] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:28.569690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.580079 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2eba4-b1d3-441a-8624-ee2699e6e4d7 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.585318 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.585961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.586240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.586514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] PATH_INFO: `/v3/projects/c54d9864adb749faa1d8c82665e1e537/users/5d82433b00414e3fba6e27c16691f988/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.588504 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54d9864adb749faa1d8c82665e1e537, user_id=5d82433b00414e3fba6e27c16691f988, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.591118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.601832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1349/2715] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:28 2022] PUT /identity/v3/projects/c54d9864adb749faa1d8c82665e1e537/users/5d82433b00414e3fba6e27c16691f988/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:28.611841 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.612150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.612429 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.640445 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] MFA Rules not processed for user `5d82433b00414e3fba6e27c16691f988`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:28.641619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:28.685628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:28.712472 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1367/2716] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:28.723304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:28.725778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:28.782671 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4dd17-443f-4465-ba26-db907a4e5e35 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:28.786825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:28.787423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:28.787736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:28.788016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:28.794862 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:28.797409 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:28.799330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d302ec-0936-4cfb-94f5-3b864c246814 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:28.810093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1350/2717] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:29.374768 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:29.436781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6119c2c-be8d-4e75-b76b-c94b30edf0f4 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:29.441223 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:29.441847 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:29.442125 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:29.442397 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] PATH_INFO: `/v3/users/e00f5301a0a34f50b58b224c69c85102` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:29.444170 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00f5301a0a34f50b58b224c69c85102)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:29.446077 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:29.493842 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00f5301a0a34f50b58b224c69c85102'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:29.494493 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00f5301a0a34f50b58b224c69c85102'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:29.495087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00f5301a0a34f50b58b224c69c85102'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:29.502406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00f5301a0a34f50b58b224c69c85102'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:29.509955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00f5301a0a34f50b58b224c69c85102'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:29.527412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1368/2718] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:29 2022] DELETE /identity/v3/users/e00f5301a0a34f50b58b224c69c85102 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:29.531943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:29.532398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:29.532515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:29.551793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:29.553907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:29.611361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1351/2719] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:04:29.621499 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:29.622942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:29.681047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125d507-692c-410f-9888-c4f33891f74d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:29.684636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:29.685233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:29.685508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:29.685775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:29.695118 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:29.696506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:29.705965 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1369/2720] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:29.975946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:29.977499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:29.990879 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a16af4-9e4b-4e43-b4a2-df443fa42de7 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:29.995433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:29.996775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:29.996901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:29.997333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] PATH_INFO: `/v3/projects/c44aa3f0716a489cb3343dfb56beeaa2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:29.998463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] RBAC: Authorizing `identity:delete_project(project_id=c44aa3f0716a489cb3343dfb56beeaa2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.000542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.047621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c44aa3f0716a489cb3343dfb56beeaa2', 'request_id': 'req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.053757 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c44aa3f0716a489cb3343dfb56beeaa2', 'request_id': 'req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.059303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c44aa3f0716a489cb3343dfb56beeaa2', 'request_id': 'req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.071672 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] The token cache is being invalidate because project c44aa3f0716a489cb3343dfb56beeaa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:30.071959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.072578 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.074061 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1352/2721] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:29 2022] DELETE /identity/v3/projects/c44aa3f0716a489cb3343dfb56beeaa2 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:30.078015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.082854 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:30.089812 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ed631-75cc-4ea3-9a09-ebf363994e9b service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.145657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.146905 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.147184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.147457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] PATH_INFO: `/v3/users/5d82433b00414e3fba6e27c16691f988` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.148607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d82433b00414e3fba6e27c16691f988)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.150552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.196463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d82433b00414e3fba6e27c16691f988'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.197117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d82433b00414e3fba6e27c16691f988'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.197727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d82433b00414e3fba6e27c16691f988'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.204761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d82433b00414e3fba6e27c16691f988'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.212825 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-e7389cdc-57cf-4c49-ad65-a293ff0314f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d82433b00414e3fba6e27c16691f988'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.229879 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1370/2722] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:04:30 2022] DELETE /identity/v3/users/5d82433b00414e3fba6e27c16691f988 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:30.499640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.501272 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:30.515135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce72cd1-533a-4f5b-b76d-91e6c1bf87da admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.574886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.575570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.575819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.576095 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] PATH_INFO: `/v3/projects/c54d9864adb749faa1d8c82665e1e537` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.577216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54d9864adb749faa1d8c82665e1e537)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.579093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.602866 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:30.626619 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54d9864adb749faa1d8c82665e1e537', 'request_id': 'req-7f2d748d-4070-4574-8be2-d6c1670a62fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.633439 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54d9864adb749faa1d8c82665e1e537', 'request_id': 'req-7f2d748d-4070-4574-8be2-d6c1670a62fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.638886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54d9864adb749faa1d8c82665e1e537', 'request_id': 'req-7f2d748d-4070-4574-8be2-d6c1670a62fb'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.652020 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] The token cache is being invalidate because project c54d9864adb749faa1d8c82665e1e537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:04:30.652319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.652945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-7f2d748d-4070-4574-8be2-d6c1670a62fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:04:30.654403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1353/2723] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:04:30 2022] DELETE /identity/v3/projects/c54d9864adb749faa1d8c82665e1e537 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:30.659658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.660153 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.660261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.680331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:30.681535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:30.742724 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1371/2724] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:30.750297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.750576 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.750850 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.770754 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:30.772103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:30.779984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1354/2725] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:04:30.784105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.794112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5649f3-e8a9-41cd-bba3-c73429b4b19b None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.798923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.799610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.799896 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.800171 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.800837 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:04:30.801140 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.803256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.815007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1372/2726] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:04:30.819885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.829022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c9136-ee4e-4976-b8d3-2f70f674f5d1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.833694 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.834261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.834535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.834805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.835429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.837328 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.863924 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1355/2727] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:30 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:30.868877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.878772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74f5f3-2e2b-49b3-84ef-b24e9ed7d5ab admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.883917 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:30.936116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.936735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.936993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.937259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.937869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.939779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.961456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1373/2728] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:30 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:30.965490 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:30.976310 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df620-1762-43c2-bd52-9cd3561e9c40 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:30.980960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:30.981560 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:30.981839 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:30.982112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:30.982750 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:30.984365 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:30.994794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1356/2729] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:30.998587 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:31.008725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf148a-0b63-4a50-9579-774cab5815cb admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:31.013347 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:31.013932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:31.014205 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:31.014470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:31.015101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:31.016705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4afd05-d417-4fee-8553-f53a7544cfe2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:31.027428 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1374/2730] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:04:31.031836 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:31.042355 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87635f-c9aa-4756-af7b-e9dda688835d admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:31.047109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:31.048035 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:31.048312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:31.048584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] PATH_INFO: `/v3/projects/938b840dc7e54c7490a2fe61fd68b57c/users/5cae4c61377e41e4bfc97165db2af888/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:31.063464 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938b840dc7e54c7490a2fe61fd68b57c, user_id=5cae4c61377e41e4bfc97165db2af888, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:31.066097 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:31.078444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1357/2731] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:31 2022] PUT /identity/v3/projects/938b840dc7e54c7490a2fe61fd68b57c/users/5cae4c61377e41e4bfc97165db2af888/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:31.083602 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa41b-f3d1-4b88-be42-74c1cf279e08 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:31.083983 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa41b-f3d1-4b88-be42-74c1cf279e08 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:31.084258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fa41b-f3d1-4b88-be42-74c1cf279e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:31.103110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c99fa41b-f3d1-4b88-be42-74c1cf279e08 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:31.104362 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c99fa41b-f3d1-4b88-be42-74c1cf279e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:31.176000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1375/2732] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:31.186656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:31.188362 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:31.255220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd23e53f-1f8b-4032-9f3c-9ee4fae37b36 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:31.260413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:31.261353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:31.261799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:31.262287 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:31.274053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:31.276243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:31.288659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1358/2733] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:31.942618 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:31.943694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:31.943694 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:31.973699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] MFA Rules not processed for user `5cae4c61377e41e4bfc97165db2af888`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:31.975265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:32.042876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1376/2734] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:32.047349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.057393 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9614f72-5ce1-45ca-8788-4f102fd59000 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.061973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.062565 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.062842 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.063114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.063768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.065640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.096977 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1359/2735] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:04:32 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:32.098386 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.109682 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc682fac-f265-4f25-a4d0-f507fbff74b2 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.122954 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:32.171849 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.172729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.173037 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.173309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.173948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.175926 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.200553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1377/2736] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:04:32 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:04:32.204962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.215552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775b9c3-0801-4a80-ab56-01013d28cfb3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.220129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.220734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.221010 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.221278 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.221939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.223550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.235129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1360/2737] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:32.239663 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.250521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131f1b1a-2e62-4d0a-8438-e2684108fa63 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.255248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.256821 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.257099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.257366 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] PATH_INFO: `/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8/users/2607c46e29684aa294ee4602a22288e7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.272076 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b55898c1ad4ee4ae27f88c387dc6a8, user_id=2607c46e29684aa294ee4602a22288e7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.274706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.288639 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1378/2738] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:32 2022] PUT /identity/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8/users/2607c46e29684aa294ee4602a22288e7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:04:32.292643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.303520 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890e4a3-7e2a-443f-b1f0-e092f2f7e921 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.314801 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:32.361999 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.362526 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.362806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.363086 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.363749 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.365885 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c379903-9f06-44fd-ab7a-755d3edfd5f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.375456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1361/2739] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:04:32.379650 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:32.390796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51725a2f-6efb-4e6f-988a-81a9dec212b2 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:32.395488 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:32.396400 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:32.396701 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:32.396998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] PATH_INFO: `/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8/users/2607c46e29684aa294ee4602a22288e7/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:32.399087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10b55898c1ad4ee4ae27f88c387dc6a8, user_id=2607c46e29684aa294ee4602a22288e7, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:32.401741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b331e2-c361-478b-bdc3-b825dbc9ea41 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:32.411923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1379/2740] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:04:32 2022] PUT /identity/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8/users/2607c46e29684aa294ee4602a22288e7/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:04:33.313555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:33.314045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:33.314658 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:33.344423 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] MFA Rules not processed for user `2607c46e29684aa294ee4602a22288e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:33.345662 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:33.416661 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1362/2741] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:33.427259 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:33.427851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:33.428181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:33.447944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] MFA Rules not processed for user `5cae4c61377e41e4bfc97165db2af888`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:33.449165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:33.515380 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1380/2742] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:33.530066 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:33.531238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:33.605265 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3d83c-576c-416e-88ca-1958f8aede3c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:33.610742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:33.611341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:33.611654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:33.611929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:33.620276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:33.621961 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:33.631376 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1363/2743] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:37.838963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:37.895888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98452d1a-1e34-43e1-8fbb-69debde2ba01 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:37.900314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:37.900934 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:37.901217 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:37.901490 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:37.903228 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:37.913328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:37.914761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c8a002-a79d-418b-b521-068c5ac91cb2 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:37.924804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1381/2744] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:39.054984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:39.069953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18419c95-3cee-4fe7-9d7e-eb35322b5de3 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:39.077701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:39.078555 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:39.078951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:39.079347 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:39.081876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:39.099216 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:39.101644 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:39.119688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1364/2745] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:43.120781 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:43.121290 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:43.121412 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:43.142062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] MFA Rules not processed for user `cfd09631436b4f85b39ca53614f214e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:04:43.143273 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:43.154904 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:43.198742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1382/2746] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:04:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:04:49.110497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=96 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:49.185145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:04:49.186551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:04:49.243202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172b535-2231-4a25-b64d-f1d067abd406 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:04:49.246805 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:04:49.247406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:04:49.247715 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:04:49.247990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:04:49.256888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:04:49.258335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:04:49.268050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1365/2747] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:04:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:04:53.192073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=17 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:04:59.263861 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=26 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:08.635640 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:08.637589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:08.713357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37acc57-97b4-4b7d-a70b-22a4fa52c820 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:08.719233 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:08.719889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:08.720185 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:08.720787 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:08.722560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:08.734717 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:08.736263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:08.746315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1383/2748] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:09.144946 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:09.159692 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017dbbe-2910-4958-a6ee-9366ac689d63 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:09.166947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:09.167594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:09.167881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:09.168153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:09.170637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:09.183735 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:09.185914 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:09.198253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1366/2749] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:09.202635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:09.268184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcf5ca-25ea-43a9-81a4-46af89301bab service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:09.273023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:09.273657 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:09.273941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:09.274241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] PATH_INFO: `/v3/users/5cae4c61377e41e4bfc97165db2af888` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:09.275368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cae4c61377e41e4bfc97165db2af888)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:09.277343 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:09.322181 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cae4c61377e41e4bfc97165db2af888'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.322833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cae4c61377e41e4bfc97165db2af888'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.323455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cae4c61377e41e4bfc97165db2af888'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.330833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cae4c61377e41e4bfc97165db2af888'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.337758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cae4c61377e41e4bfc97165db2af888'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.355658 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1384/2750] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:09 2022] DELETE /identity/v3/users/5cae4c61377e41e4bfc97165db2af888 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:05:09.534302 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:09.547889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0591fd9-0a9a-40f0-af9e-3015ff47a7c8 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:09.608413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:09.609045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:09.609320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:09.609593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] PATH_INFO: `/v3/projects/938b840dc7e54c7490a2fe61fd68b57c` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:09.610688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=938b840dc7e54c7490a2fe61fd68b57c)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:09.612616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:09.658686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938b840dc7e54c7490a2fe61fd68b57c', 'request_id': 'req-2f9ef4e4-829d-4a26-a023-161b4569cf9c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.664821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938b840dc7e54c7490a2fe61fd68b57c', 'request_id': 'req-2f9ef4e4-829d-4a26-a023-161b4569cf9c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.670574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938b840dc7e54c7490a2fe61fd68b57c', 'request_id': 'req-2f9ef4e4-829d-4a26-a023-161b4569cf9c'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.682416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] The token cache is being invalidate because project 938b840dc7e54c7490a2fe61fd68b57c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:09.682702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.683317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.685489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1367/2751] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:09 2022] DELETE /identity/v3/projects/938b840dc7e54c7490a2fe61fd68b57c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:09.689507 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:09.690929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:09.704978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ed9c-8cfc-45e4-a8b2-2056a36cc224 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:09.709758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:09.765626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:09.766288 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:09.766565 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:09.766866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] PATH_INFO: `/v3/users/2607c46e29684aa294ee4602a22288e7` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:09.768047 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2607c46e29684aa294ee4602a22288e7)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:09.770058 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:09.822832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2607c46e29684aa294ee4602a22288e7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.823352 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2607c46e29684aa294ee4602a22288e7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.823987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2607c46e29684aa294ee4602a22288e7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.831688 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2607c46e29684aa294ee4602a22288e7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.839248 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b19760c2-209e-43aa-8d8c-95ce4ec647ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2607c46e29684aa294ee4602a22288e7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:09.856789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1385/2752] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:09 2022] DELETE /identity/v3/users/2607c46e29684aa294ee4602a22288e7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:10.026457 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.028072 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.045195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ef4e4-829d-4a26-a023-161b4569cf9c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.102686 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.103231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.103535 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.103807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] PATH_INFO: `/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.104907 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10b55898c1ad4ee4ae27f88c387dc6a8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.107319 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.128279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:10.154913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10b55898c1ad4ee4ae27f88c387dc6a8', 'request_id': 'req-29f5e773-012d-4028-b7d8-0cbc9492996d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.161070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10b55898c1ad4ee4ae27f88c387dc6a8', 'request_id': 'req-29f5e773-012d-4028-b7d8-0cbc9492996d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.166643 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10b55898c1ad4ee4ae27f88c387dc6a8', 'request_id': 'req-29f5e773-012d-4028-b7d8-0cbc9492996d'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.178891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] The token cache is being invalidate because project 10b55898c1ad4ee4ae27f88c387dc6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:10.179586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.180201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-29f5e773-012d-4028-b7d8-0cbc9492996d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:10.181640 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1368/2753] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:10 2022] DELETE /identity/v3/projects/10b55898c1ad4ee4ae27f88c387dc6a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:10.188331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.188619 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.188894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.208009 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:10.209213 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.267581 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1386/2754] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:10.275238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.275579 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.275859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.296224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:10.297416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.305430 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1369/2755] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:10.310023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.319729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce9fff-0b1f-407a-9a0f-ab7973eab2b3 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.324253 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.324933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.325448 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.325729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.326368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:05:10.326670 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.328286 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.339713 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1387/2756] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:05:10.344614 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.353734 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d75f-1935-47d8-9ff3-7a186d85fd0f None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.359194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.359812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.360091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.360361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.360971 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.362847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.389992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1370/2757] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:10.394022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.404749 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c27dd-1d06-4286-b8f3-ee6c18a84a09 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.416087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:10.465165 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.466320 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.466649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.466866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.467508 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.469530 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.491377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1388/2758] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:10.495597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.506291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c1c05-cc1c-4767-83aa-aef00c1b44ea admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.510877 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.511496 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.511770 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.512037 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.512690 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.514281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.524036 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1371/2759] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:10.527794 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.538423 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc3f01-84cb-4b3f-b146-ca9d39d30fc1 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.543116 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.544301 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.544582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.544893 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.545541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.547157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944b89c-a7fb-43a0-b427-d895a0cc453d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.558147 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1389/2760] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:10.568553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.578894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc4e6a-dc2f-43a7-9585-e67071c40ec4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.583498 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.584160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.584440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.584716 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] PATH_INFO: `/v3/projects/0a53b5955b4c48089bacba9acb958253/users/c452620e6cd14819a826636d14cbf170/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.599260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a53b5955b4c48089bacba9acb958253, user_id=c452620e6cd14819a826636d14cbf170, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.601901 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.615009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1372/2761] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:10 2022] PUT /identity/v3/projects/0a53b5955b4c48089bacba9acb958253/users/c452620e6cd14819a826636d14cbf170/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:05:10.624751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.625071 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.625350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.652584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] MFA Rules not processed for user `c452620e6cd14819a826636d14cbf170`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:10.654457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.720709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1390/2762] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:10.731605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:10.733372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:10.808528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9048bf-6f51-4655-bac1-01451787bc25 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:10.812228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:10.812820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:10.813091 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:10.813359 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:10.821413 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:10.822812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0a0fd-9c4b-465d-b211-5c57e66ce54c service glance] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:10.831898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1373/2763] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:20.717861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:20.828126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:30.509869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:30.572112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e81a12-e946-44d8-a04a-c01f81543473 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:30.576856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:30.578162 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.578449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.578726 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] PATH_INFO: `/v3/users/c452620e6cd14819a826636d14cbf170` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.580406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c452620e6cd14819a826636d14cbf170)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:30.582345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:30.627706 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c452620e6cd14819a826636d14cbf170'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:30.628404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c452620e6cd14819a826636d14cbf170'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:30.629015 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c452620e6cd14819a826636d14cbf170'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:30.638310 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c452620e6cd14819a826636d14cbf170'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:30.647436 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c452620e6cd14819a826636d14cbf170'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:30.665668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1391/2764] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:30 2022] DELETE /identity/v3/users/c452620e6cd14819a826636d14cbf170 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:30.670534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.671295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.671599 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.692179 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:30.693379 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:30.751516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1374/2765] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:30.761041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:30.762447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:30.819568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ebad71-9874-4be8-ba06-c2dee39e398f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:30.823193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:30.823819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:30.824097 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:30.824371 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:30.833714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:30.835127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9696759-8ffa-4a60-9a5c-341b1e3ce496 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:30.844418 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1392/2766] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:31.367768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.369248 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:31.381970 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f365d689-3adb-422b-a6e1-3a0d970310d4 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.386791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.387419 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.387719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.387994 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] PATH_INFO: `/v3/projects/0a53b5955b4c48089bacba9acb958253` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.389126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a53b5955b4c48089bacba9acb958253)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.391047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.437790 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a53b5955b4c48089bacba9acb958253', 'request_id': 'req-cb18839f-6599-4c80-88a8-18b8a462fc9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:31.444593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a53b5955b4c48089bacba9acb958253', 'request_id': 'req-cb18839f-6599-4c80-88a8-18b8a462fc9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:31.450128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a53b5955b4c48089bacba9acb958253', 'request_id': 'req-cb18839f-6599-4c80-88a8-18b8a462fc9e'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:31.463202 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] The token cache is being invalidate because project 0a53b5955b4c48089bacba9acb958253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:31.463508 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:31.464112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-cb18839f-6599-4c80-88a8-18b8a462fc9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:31.465605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1375/2767] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:31 2022] DELETE /identity/v3/projects/0a53b5955b4c48089bacba9acb958253 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:31.470606 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.470907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.471179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.491590 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:31.492822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:31.510489 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:31.555184 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1393/2768] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:31.562956 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.563240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.563564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.583826 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:31.585034 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:31.592945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1376/2769] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:31.597127 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.606766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b49d31-2720-4b26-80ff-17f4c577b099 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.611861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.612452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.612730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.613000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.613634 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:05:31.613937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.615541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.627950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1394/2770] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:05:31.632118 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.641156 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364d7b2-5d38-4c55-b37d-7e738620b586 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.645660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.646240 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.646515 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.646775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.647389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.649279 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.676654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1377/2771] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:05:31.680863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.691342 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c43c429-bb21-4554-b459-67180eb6d627 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.747163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.747719 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.748000 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.748275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.748887 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.750822 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.773464 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1395/2772] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:05:31.777458 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.788539 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a43cf-3817-4467-96ab-2dbd71644bca admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.793155 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.793751 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.794031 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.794303 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.794941 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.796550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.807368 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1378/2773] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:31.811433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.821467 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98279519-7046-455f-9320-5e9e24cb8b7d admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.826011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.826589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.826863 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.827132 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.827797 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.829363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6795d0c8-ae44-4877-9631-caa37f29647f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.839862 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1396/2774] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:05:31.843758 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:31.855052 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ed6f4-7e01-4ae8-824f-5b111cc010ea admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:31.859848 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:31.860494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.860773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.861768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] PATH_INFO: `/v3/projects/4086f2d7a6c749b6b43daeb53f57131a/users/78f7f1669af142019ec9fcf47187246d/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.877677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4086f2d7a6c749b6b43daeb53f57131a, user_id=78f7f1669af142019ec9fcf47187246d, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:31.880357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:31.893094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1379/2775] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:05:31 2022] PUT /identity/v3/projects/4086f2d7a6c749b6b43daeb53f57131a/users/78f7f1669af142019ec9fcf47187246d/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:31.903287 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:31.903608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:31.903888 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:31.932203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] MFA Rules not processed for user `78f7f1669af142019ec9fcf47187246d`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:31.933689 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:31.998324 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1397/2776] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:05:32.032123 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:32.034674 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:32.055817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:32.092590 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723037d-4fb6-4f8a-bf8c-4174451eed9c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:32.097022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:32.097712 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:32.097909 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:32.098180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:32.106628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:32.108076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae640ce-f8b4-475c-9ac9-9eedf847c46c service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:32.117121 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1380/2777] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:32.133188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:32.152591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:32.196751 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c781a7a-d5d7-49de-a7bc-ab1a0ef239ed None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:32.201452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:32.202081 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:32.202383 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:32.202655 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] PATH_INFO: `/v3/users/78f7f1669af142019ec9fcf47187246d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:32.203816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78f7f1669af142019ec9fcf47187246d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:32.206241 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:32.250969 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78f7f1669af142019ec9fcf47187246d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.251586 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78f7f1669af142019ec9fcf47187246d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.252212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78f7f1669af142019ec9fcf47187246d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.259039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78f7f1669af142019ec9fcf47187246d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.266046 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78f7f1669af142019ec9fcf47187246d'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.284145 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1398/2778] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:05:32 2022] DELETE /identity/v3/users/78f7f1669af142019ec9fcf47187246d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:32.288729 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:32.289016 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:32.289291 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:32.308030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:05:32.309234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:32.367183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1381/2779] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:05:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:05:32.377391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:32.378801 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:32.435962 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39023f3-26a1-4e9c-a30e-711444f69e62 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:32.440061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:32.440647 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:32.440923 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:32.441191 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:32.450041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:32.451452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:32.462210 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1399/2780] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:05:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:05:32.726765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:05:32.728198 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:05:32.740494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fb46-651a-492e-b59d-02ac621a8cc2 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:05:32.744953 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:05:32.745584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:05:32.745865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:05:32.746138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] PATH_INFO: `/v3/projects/4086f2d7a6c749b6b43daeb53f57131a` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:05:32.747247 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4086f2d7a6c749b6b43daeb53f57131a)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:05:32.749211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:05:32.800595 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4086f2d7a6c749b6b43daeb53f57131a', 'request_id': 'req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.806976 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4086f2d7a6c749b6b43daeb53f57131a', 'request_id': 'req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.812787 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4086f2d7a6c749b6b43daeb53f57131a', 'request_id': 'req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.826071 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] The token cache is being invalidate because project 4086f2d7a6c749b6b43daeb53f57131a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:05:32.826389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.827009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:05:32.828556 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1382/2781] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:05:32 2022] DELETE /identity/v3/projects/4086f2d7a6c749b6b43daeb53f57131a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:05:42.457866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:05:42.822973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:13.989178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:13.990656 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:14.064481 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647a36-6a40-4327-a660-1a74421a88ff service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:14.125899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:14.126504 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:14.126784 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:14.127056 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:14.128866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:14.186053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:14.187646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73416d65-d415-4dc8-8fe6-8be2e9644539 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:14.196684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1400/2782] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:24.192573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=84 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:31.500947 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:31.502530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:31.519331 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de69d42-dffc-4ec9-b0f3-0d21cbdaaa1f admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:31.526134 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:31.526775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:31.527046 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:31.527312 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:31.529125 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:31.542984 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:31.544638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:31.555411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1383/2783] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:06:33.747007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bb11d-aea5-42c0-948d-22e520fcd9cb None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:33.747533 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bb11d-aea5-42c0-948d-22e520fcd9cb None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:33.747648 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bb11d-aea5-42c0-948d-22e520fcd9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:33.799033 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-012bb11d-aea5-42c0-948d-22e520fcd9cb None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:06:33.800281 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-012bb11d-aea5-42c0-948d-22e520fcd9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:33.866668 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1401/2784] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 05:06:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:06:33.913557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:33.914962 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:34.007898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564edb82-be72-4d78-9d73-35152b95e95c service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:34.014403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:34.015014 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:34.015313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:34.015602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:34.024317 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:34.026646 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de117007-ca99-4bc9-8d49-fde21551c42a service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:34.034998 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1384/2785] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:06:43.863733 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=40 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:44.031682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=47 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:47.179257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.179834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.180026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] PATH_INFO: `/` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.181440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1402/2786] 10.222.0.85 () {54 vars in 921 bytes} [Wed Aug 24 05:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 05:06:47.186763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.187219 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.187424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.226096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] MFA Rules not processed for user `640768a362f64590b7cc779353b02b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:06:47.227211 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.236574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1385/2787] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Aug 24 05:06:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:06:47.248271 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:47.250001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.311110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dec3c-62ec-4e87-b0ba-25a9b589a5f8 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:47.314690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773a16903bb41a9b871ddd3534e5873', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:47.315295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.315600 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.315869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.326356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:47.327804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:47.338584 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1403/2788] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:06:47.407631 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:47.409022 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.469679 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda9491-a7ca-4138-ab63-6dfc55607269 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:47.473334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:47.473938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.474218 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.474492 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.476321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.486370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:47.487995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:47.496471 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1386/2789] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:47.572203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:47.574376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.586714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18617d99-8c14-460a-a67d-69d09d5ce6ad service glance] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:47.591457 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:47.591649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.591876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.592149 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.594061 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.608134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:47.609560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a308011-fd5a-44a4-becb-d6c18d066419 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:47.620844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1404/2790] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:47.681541 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:47.683000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.752648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9103b-04dc-47d4-ac1d-90f8201b314f service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:47.757454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:47.758075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:47.758353 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:47.758630 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:47.760363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:47.772398 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:47.773943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:47.783772 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1387/2791] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:06:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:06:49.343219 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e13b-d082-46fb-bf26-297eaa776a0c None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:49.343723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e13b-d082-46fb-bf26-297eaa776a0c None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:49.343838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7e13b-d082-46fb-bf26-297eaa776a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:49.363110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8db7e13b-d082-46fb-bf26-297eaa776a0c None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:06:49.364326 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8db7e13b-d082-46fb-bf26-297eaa776a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:06:49.371319 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1405/2792] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Aug 24 05:06:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:06:49.383102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:06:49.394501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904dd4f-82a0-41d3-b190-dc88a44f7053 service placement] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:06:49.399426 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:06:49.400047 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:06:49.400329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:06:49.400602 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:06:49.409262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:06:49.410816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:06:49.419502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1388/2793] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:06:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:06:59.358403 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=35 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:06:59.415681 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=73 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:07.715142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:07:07.715712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:07:07.715712 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:07:07.735613 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] MFA Rules not processed for user `89178d161ef04543903f563ef4fc599a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:07:07.736810 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:07:07.743950 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1406/2794] 10.222.0.85 () {58 vars in 967 bytes} [Wed Aug 24 05:07:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:07:07.756192 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:07:07.768345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c227332-5743-4b34-91c1-67d30e3bef08 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:07:07.773345 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3a2418aa8404c7995c1e8a84ae66627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:07:07.773934 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:07:07.774212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:07:07.774480 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:07:07.783402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:07:07.785206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:07:07.793235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1389/2795] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Aug 24 05:07:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 05:07:17.730778 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:17.789958 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=6 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:07:51.850652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:07:51.852126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:07:51.867377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795ca8f-fc8f-4ae5-a0ca-49b3fdc68580 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:07:51.872265 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:07:51.872856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:07:51.873152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:07:51.873408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:07:51.875069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:07:51.886882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:07:51.888474 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:07:51.898523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1407/2796] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:07:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:01.894053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=6 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:10.853564 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:10.862759 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a99191-f952-4abf-828b-bb501fec3c50 service swift] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:10.866992 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:10.867604 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:10.867881 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:10.868150 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:10.869838 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:10.933558 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:10.934986 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:10.944688 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1390/2797] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:13.813649 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:13.815239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:13.830150 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345bc26-27fc-45ef-8a4d-8aca64354a70 service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:13.834955 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:13.835645 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:13.835929 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:13.836200 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] PATH_INFO: `/v3/users/cfd09631436b4f85b39ca53614f214e9` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:13.837415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd09631436b4f85b39ca53614f214e9)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:13.839325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:13.891652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd09631436b4f85b39ca53614f214e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:13.892364 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd09631436b4f85b39ca53614f214e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:13.892977 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd09631436b4f85b39ca53614f214e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:13.900743 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd09631436b4f85b39ca53614f214e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:13.909355 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-cbaca0a1-cc93-485c-964e-7171fca2bbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd09631436b4f85b39ca53614f214e9'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:13.929138 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1408/2798] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:13 2022] DELETE /identity/v3/users/cfd09631436b4f85b39ca53614f214e9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:14.115372 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.126979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d187c-72e8-4bc8-88e8-b54388d14a3f service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.185444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.186070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.186349 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.186621 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] PATH_INFO: `/v3/projects/d8c9aacf135a44fcb9f1b0305b787fd2` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.187891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c9aacf135a44fcb9f1b0305b787fd2)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.189829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.237357 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c9aacf135a44fcb9f1b0305b787fd2', 'request_id': 'req-8c8c1a95-47f2-4022-9d66-f4705056dff4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:14.243698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c9aacf135a44fcb9f1b0305b787fd2', 'request_id': 'req-8c8c1a95-47f2-4022-9d66-f4705056dff4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:14.249435 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c9aacf135a44fcb9f1b0305b787fd2', 'request_id': 'req-8c8c1a95-47f2-4022-9d66-f4705056dff4'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:14.269313 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] The token cache is being invalidate because project d8c9aacf135a44fcb9f1b0305b787fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:14.269822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:14.271585 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-8c8c1a95-47f2-4022-9d66-f4705056dff4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:14.274112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1391/2799] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:14 2022] DELETE /identity/v3/projects/d8c9aacf135a44fcb9f1b0305b787fd2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:08:14.279202 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.279522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.279804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.299087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:14.300322 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:14.360677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1409/2800] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:14.369215 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.369543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.369763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.389719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:14.391025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:14.398717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1392/2801] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:14.402931 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.412736 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400ed7-c278-4269-963a-0daaa39b5471 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.417245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.417834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.418109 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.418377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.419007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:08:14.419305 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.420906 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.432690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1410/2802] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:08:14.436778 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.446444 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dff79d-b09d-4c84-912d-8e424d91d365 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.451264 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.451882 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.452159 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.452425 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.453042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.454913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.470775 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:14.483568 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1393/2803] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:14.487815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.498623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0edf64-259e-465c-838f-b54fb5cd0866 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.554840 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.555453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.555758 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.556034 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.556666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.558563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.572110 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:14.585388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1411/2804] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:14.589586 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.600068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e644c1-ef07-4137-bf0f-3045a6e417e3 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.604835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.605440 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.605719 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.605990 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.606663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.608281 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.618810 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1394/2805] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:08:14.622809 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.633251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409520d4-396d-40f4-91ed-5b5416fa1c73 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.637895 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.638484 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.638766 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.639040 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.639725 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.641311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9c1df-d58f-403b-9fb4-7c5a995d1de0 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.652013 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1412/2806] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:14.656070 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.666708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cbf4b-86ee-40d6-9014-4427f4fdb2eb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.671459 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.672120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.672395 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.672663 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] PATH_INFO: `/v3/projects/5609fb5931e54bc78aaa2eb175e2e84f/users/910e122aaae5460fba4228273f199e1f/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.687849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5609fb5931e54bc78aaa2eb175e2e84f, user_id=910e122aaae5460fba4228273f199e1f, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.690463 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.703200 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1395/2807] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:14 2022] PUT /identity/v3/projects/5609fb5931e54bc78aaa2eb175e2e84f/users/910e122aaae5460fba4228273f199e1f/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:14.714936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.715216 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.715513 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.743838 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] MFA Rules not processed for user `910e122aaae5460fba4228273f199e1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:14.745031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:14.809483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1413/2808] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:14.814321 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.877412 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289e4b9-e876-43fa-b1c5-7e0758e9cdd5 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.882113 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.882709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.882988 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.883260 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.883913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.885791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:14.911739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1396/2809] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:14.915804 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:14.927329 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6706ce-a6e4-4a69-9dc4-668849f2a366 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:14.984527 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:14.985135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:14.985415 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:14.985685 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:14.986311 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:14.988307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.010438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1414/2810] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:14 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:15.014456 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.025183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18de64-8f00-4f4e-a93d-810835e1aadc admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.030001 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.030593 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.030876 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.031152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.031819 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.033400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.044945 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1397/2811] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:15.049180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.059179 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64745e20-6d61-4196-96f7-df70bd1ea23e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.063933 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.064579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.064856 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.065126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] PATH_INFO: `/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5/users/79fb7774c6664e719a0f3f5bf950e8a1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.079995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a29b020f0e450b9204a0f3c7a5d9b5, user_id=79fb7774c6664e719a0f3f5bf950e8a1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.083404 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.095927 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1415/2812] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:15 2022] PUT /identity/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5/users/79fb7774c6664e719a0f3f5bf950e8a1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:08:15.100437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.110370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d39f8f-4758-497e-888b-f6d82fce8fca admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.165402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.166044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.166190 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.166483 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.167111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.168727 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba64e5-02b6-46f4-b171-0422a9eddc3a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.179109 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1398/2813] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:15.183245 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.194117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc41084f-cd7b-4c85-abc2-9174ba2aa47f admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.198723 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.199363 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.199675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.200055 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] PATH_INFO: `/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5/users/79fb7774c6664e719a0f3f5bf950e8a1/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.202254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60a29b020f0e450b9204a0f3c7a5d9b5, user_id=79fb7774c6664e719a0f3f5bf950e8a1, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.205023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.215643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1416/2814] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:15 2022] PUT /identity/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5/users/79fb7774c6664e719a0f3f5bf950e8a1/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:15.226201 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.226481 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.226779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.256063 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] MFA Rules not processed for user `79fb7774c6664e719a0f3f5bf950e8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:15.257270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:15.275250 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:15.324855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1399/2815] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:15.336711 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.338470 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:15.361604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:15.398119 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f93d94-8503-42d9-bdd4-2a58da817c94 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.401705 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.402308 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.402583 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.402853 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.412832 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.414283 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9d1d0-24a9-41d1-9254-372c5c71032b service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.423573 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1417/2816] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:15.809462 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:15.875041 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee967512-5081-41a6-b727-18a0f22870ae None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:15.879818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:15.880467 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.881295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.881567 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] PATH_INFO: `/v3/users/910e122aaae5460fba4228273f199e1f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.890552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] RBAC: Authorizing `identity:delete_user(user_id=910e122aaae5460fba4228273f199e1f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:15.893443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:15.938760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '910e122aaae5460fba4228273f199e1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:15.939348 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '910e122aaae5460fba4228273f199e1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:15.947067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '910e122aaae5460fba4228273f199e1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:15.947714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '910e122aaae5460fba4228273f199e1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:15.955058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '910e122aaae5460fba4228273f199e1f'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:15.972008 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1400/2817] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:15 2022] DELETE /identity/v3/users/910e122aaae5460fba4228273f199e1f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:15.976536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:15.977020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:15.977120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:15.996104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:15.997318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:16.066105 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1418/2818] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:16.076400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:16.077794 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:16.118417 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:16.137206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238940a-426e-4567-bc49-6ebe62dc3abb admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:16.140863 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:16.141461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:16.141741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:16.142015 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:16.151832 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:16.153234 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:16.162656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1401/2819] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:16.426897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:16.428976 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:16.440846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b908-7675-413e-bae6-c6e7e0a38c50 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:16.446391 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:16.447035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:16.447408 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:16.447714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] PATH_INFO: `/v3/projects/5609fb5931e54bc78aaa2eb175e2e84f` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:16.448850 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5609fb5931e54bc78aaa2eb175e2e84f)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:16.450761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:16.499636 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5609fb5931e54bc78aaa2eb175e2e84f', 'request_id': 'req-6f84f279-3cd6-4f8e-9e75-b32882589a09'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.506679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5609fb5931e54bc78aaa2eb175e2e84f', 'request_id': 'req-6f84f279-3cd6-4f8e-9e75-b32882589a09'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.516824 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5609fb5931e54bc78aaa2eb175e2e84f', 'request_id': 'req-6f84f279-3cd6-4f8e-9e75-b32882589a09'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.528735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] The token cache is being invalidate because project 5609fb5931e54bc78aaa2eb175e2e84f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:16.529026 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.529673 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.531156 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1419/2820] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:16 2022] DELETE /identity/v3/projects/5609fb5931e54bc78aaa2eb175e2e84f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:16.535153 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:16.545341 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c3c4-6f33-497c-a7f0-d35e5255caf8 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:16.601479 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:16.602096 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:16.602371 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:16.602641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] PATH_INFO: `/v3/users/79fb7774c6664e719a0f3f5bf950e8a1` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:16.603755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fb7774c6664e719a0f3f5bf950e8a1)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:16.605627 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:16.650537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fb7774c6664e719a0f3f5bf950e8a1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.651189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fb7774c6664e719a0f3f5bf950e8a1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.658542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fb7774c6664e719a0f3f5bf950e8a1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.659502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fb7774c6664e719a0f3f5bf950e8a1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.667446 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-92f56a93-56e0-447c-a8a4-d23e93017052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fb7774c6664e719a0f3f5bf950e8a1'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:16.684858 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1402/2821] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:16 2022] DELETE /identity/v3/users/79fb7774c6664e719a0f3f5bf950e8a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:16.950775 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:16.952610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:16.966142 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f279-3cd6-4f8e-9e75-b32882589a09 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.011677 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:17.025686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.026318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.026591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.026859 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] PATH_INFO: `/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.027993 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60a29b020f0e450b9204a0f3c7a5d9b5)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.029932 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.078117 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60a29b020f0e450b9204a0f3c7a5d9b5', 'request_id': 'req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:17.083693 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60a29b020f0e450b9204a0f3c7a5d9b5', 'request_id': 'req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:17.090972 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60a29b020f0e450b9204a0f3c7a5d9b5', 'request_id': 'req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:17.103498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] The token cache is being invalidate because project 60a29b020f0e450b9204a0f3c7a5d9b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:17.103796 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:17.104449 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-b327dbc9-a0c6-48c1-a840-6d116c83d8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:17.105935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1420/2822] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:16 2022] DELETE /identity/v3/projects/60a29b020f0e450b9204a0f3c7a5d9b5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:17.110991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.111293 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.111611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.131325 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:17.132514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:17.182114 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:17.192468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1403/2823] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:17.201225 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1182-230c-4fbd-9808-273f0622978e None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.201523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1182-230c-4fbd-9808-273f0622978e None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.201793 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d1182-230c-4fbd-9808-273f0622978e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.221454 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-829d1182-230c-4fbd-9808-273f0622978e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:17.222660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-829d1182-230c-4fbd-9808-273f0622978e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:17.230630 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1421/2824] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:17.234713 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.244996 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cf05f-4887-41cc-bdfd-c3ea0c29dd08 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.249616 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.250213 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.250491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.250763 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.251406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:08:17.251766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.253334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.265676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1404/2825] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:08:17.270065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1182-230c-4fbd-9808-273f0622978e None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.279399 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d1182-230c-4fbd-9808-273f0622978e None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.284345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.284882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.285182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.285452 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.286099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.288053 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.315523 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1422/2826] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:17.320119 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.330358 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20349f9-a923-4e98-8321-91b60d5aefd1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.390951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.391574 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.391852 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.392120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.392739 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.394617 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.416550 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1405/2827] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/users => generated 278 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:17.420595 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.431991 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c731-a722-41e2-8764-4b1729af367b admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.436628 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.437230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.437506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.437776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.438416 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.440039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.451240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1423/2828] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:17.455152 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.465973 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e637c52a-e7d1-4a3a-b9cf-19051bce213a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.470611 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.471204 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.471514 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.471791 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.472433 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.474005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b0c74b-b673-4aa5-bed7-df61ebc84d19 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.485354 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1406/2829] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:17.489519 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.499829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb1ae5-646e-4f1e-8bc8-ab4e1c49871a admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.504535 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.505172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.505441 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.505820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] PATH_INFO: `/v3/projects/14bf1ce45a5043eca9f70d1ad4f0e591/users/bea1ae3823c445b5b272c6a462657358/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.520503 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bf1ce45a5043eca9f70d1ad4f0e591, user_id=bea1ae3823c445b5b272c6a462657358, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.524020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.537633 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1424/2830] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:17 2022] PUT /identity/v3/projects/14bf1ce45a5043eca9f70d1ad4f0e591/users/bea1ae3823c445b5b272c6a462657358/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:17.548966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.549537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.549537 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.577068 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] MFA Rules not processed for user `bea1ae3823c445b5b272c6a462657358`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:17.578284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:17.641808 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1407/2831] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:08:17.646187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.708444 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773eafe-af9c-4381-9463-2d7eee916d5e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.713746 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.714346 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.714625 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.714897 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.715539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.717438 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.737510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:17.747406 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1425/2832] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:17.751380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.762765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069ee3b-2201-4caf-a1c3-51344addf74c None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.809454 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:17.819883 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.820488 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.820768 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.821045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.821675 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.823605 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.844589 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1408/2833] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:17 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:17.848772 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.859212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4f223-64ad-4d46-8a4b-115f94aefb3e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.864029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.864627 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.864909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.865237 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.866004 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.867626 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.878099 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1426/2834] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:17.882637 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.892742 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16160-86e0-4c0f-b79b-e3317083de99 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:17.897991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:17.898638 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:17.898920 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:17.899196 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] PATH_INFO: `/v3/projects/5eb4e9680deb49a89758bf1e845af5cd/users/7c764b0518b0480b8b31ae3e4864f1ff/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:17.915333 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb4e9680deb49a89758bf1e845af5cd, user_id=7c764b0518b0480b8b31ae3e4864f1ff, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:17.918082 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:17.931089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1409/2835] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:17 2022] PUT /identity/v3/projects/5eb4e9680deb49a89758bf1e845af5cd/users/7c764b0518b0480b8b31ae3e4864f1ff/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:17.935042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:17.945440 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501d18c-811f-4313-87f1-dc6d75e0b816 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:18.002846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:18.003455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:18.003773 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:18.004049 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:18.004684 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:18.006276 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268661-7a2d-4ccb-a89d-75b18baa46ee admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:18.015957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1427/2836] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 05:08:18.020107 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:18.030918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c39625-8415-45db-a97f-dc1b9e1a4db4 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:18.035424 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:18.036093 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:18.036367 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:18.036633 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] PATH_INFO: `/v3/projects/5eb4e9680deb49a89758bf1e845af5cd/users/7c764b0518b0480b8b31ae3e4864f1ff/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:18.039112 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb4e9680deb49a89758bf1e845af5cd, user_id=7c764b0518b0480b8b31ae3e4864f1ff, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:18.041740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:18.053416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1410/2837] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:18 2022] PUT /identity/v3/projects/5eb4e9680deb49a89758bf1e845af5cd/users/7c764b0518b0480b8b31ae3e4864f1ff/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:18.071101 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:18.071318 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:18.071644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:18.099345 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] MFA Rules not processed for user `7c764b0518b0480b8b31ae3e4864f1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:18.100774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:18.168270 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1428/2838] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:18 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:18.180146 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:18.181904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:18.246825 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7251b94-269d-4946-a3d6-ff5a5a35f12a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:18.250639 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:18.251241 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:18.251557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:18.251854 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:18.262238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:18.263698 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:18.273145 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1411/2839] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:18.353180 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:18.362867 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bce01-98a4-4d81-805c-f99bdfcf60ae None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:18.367039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:18.367679 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:18.367963 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:18.368239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:18.425697 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:18.427159 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230f9a1-de0d-45fb-a978-1e8bd5f242d8 service cinder] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:18.436936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1429/2840] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:28.268938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=46,keystone:INSERT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:28.432728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:33.245847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:33.308180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eb7abe-3454-4073-ab30-6ce0fd72caf2 service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:33.312680 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:33.313301 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:33.313580 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:33.313856 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] PATH_INFO: `/v3/users/bea1ae3823c445b5b272c6a462657358` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:33.314969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea1ae3823c445b5b272c6a462657358)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:33.316888 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:33.362647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea1ae3823c445b5b272c6a462657358'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.363290 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea1ae3823c445b5b272c6a462657358'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.370468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea1ae3823c445b5b272c6a462657358'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.371206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea1ae3823c445b5b272c6a462657358'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.379005 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea1ae3823c445b5b272c6a462657358'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.397822 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1412/2841] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:33 2022] DELETE /identity/v3/users/bea1ae3823c445b5b272c6a462657358 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:33.403068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:33.403579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:33.403696 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:33.423678 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:33.424869 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:33.484139 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1430/2842] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:33.494461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:33.495927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:33.551908 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a631c9-de1f-4579-a137-a4ea5daccdcd admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:33.556285 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:33.556886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:33.557165 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:33.557468 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:33.566416 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:33.567872 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:33.577262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1413/2843] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:33.842703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:33.844172 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:33.857226 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b337-5e4c-4f4b-95ad-34297cdca538 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:33.862524 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:33.863164 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:33.863442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:33.863944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] PATH_INFO: `/v3/projects/14bf1ce45a5043eca9f70d1ad4f0e591` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:33.865084 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bf1ce45a5043eca9f70d1ad4f0e591)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:33.867134 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:33.914456 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bf1ce45a5043eca9f70d1ad4f0e591', 'request_id': 'req-0b52765a-6e39-40ce-be12-cfdc5644d1a7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.919861 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bf1ce45a5043eca9f70d1ad4f0e591', 'request_id': 'req-0b52765a-6e39-40ce-be12-cfdc5644d1a7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.926912 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bf1ce45a5043eca9f70d1ad4f0e591', 'request_id': 'req-0b52765a-6e39-40ce-be12-cfdc5644d1a7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.937729 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] The token cache is being invalidate because project 14bf1ce45a5043eca9f70d1ad4f0e591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:33.938008 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.938624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:33.940120 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1431/2844] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:33 2022] DELETE /identity/v3/projects/14bf1ce45a5043eca9f70d1ad4f0e591 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:33.944141 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:33.953932 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a9e83-78e9-4196-a7e6-d00493a381c3 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:33.972411 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.011406 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.012045 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.012320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.012587 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] PATH_INFO: `/v3/users/7c764b0518b0480b8b31ae3e4864f1ff` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.013677 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c764b0518b0480b8b31ae3e4864f1ff)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.015620 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.062641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c764b0518b0480b8b31ae3e4864f1ff'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.063238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c764b0518b0480b8b31ae3e4864f1ff'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.070390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c764b0518b0480b8b31ae3e4864f1ff'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.070995 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c764b0518b0480b8b31ae3e4864f1ff'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.078238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-af304e13-93f7-4e73-bc06-d2fff9238ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c764b0518b0480b8b31ae3e4864f1ff'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.095391 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1414/2845] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:33 2022] DELETE /identity/v3/users/7c764b0518b0480b8b31ae3e4864f1ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:34.364039 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.365486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:34.379509 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52765a-6e39-40ce-be12-cfdc5644d1a7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.437653 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.438314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.438556 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.438829 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] PATH_INFO: `/v3/projects/5eb4e9680deb49a89758bf1e845af5cd` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.439987 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb4e9680deb49a89758bf1e845af5cd)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.441880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.474093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.494616 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb4e9680deb49a89758bf1e845af5cd', 'request_id': 'req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.501182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb4e9680deb49a89758bf1e845af5cd', 'request_id': 'req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.509252 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb4e9680deb49a89758bf1e845af5cd', 'request_id': 'req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.520651 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] The token cache is being invalidate because project 5eb4e9680deb49a89758bf1e845af5cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:34.520937 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.521566 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-2cd558e9-e939-4a3c-a1e8-5d15f0be0028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:34.523161 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1432/2846] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:34 2022] DELETE /identity/v3/projects/5eb4e9680deb49a89758bf1e845af5cd => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:34.527957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac323-1700-4333-be47-24e52a944aee None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.528415 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac323-1700-4333-be47-24e52a944aee None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.528533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ac323-1700-4333-be47-24e52a944aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.547818 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e12ac323-1700-4333-be47-24e52a944aee None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:34.549029 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e12ac323-1700-4333-be47-24e52a944aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:34.608518 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1415/2847] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:34.618022 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.618307 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.618582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.638635 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:34.639911 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:34.647945 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1433/2848] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:34.652268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ac323-1700-4333-be47-24e52a944aee None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.662019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ac323-1700-4333-be47-24e52a944aee None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.666974 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.667609 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.667891 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.668162 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] PATH_INFO: `/v3/domains` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.668802 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81491) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:08:34.669104 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.670684 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.682723 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1416/2849] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:08:34.687001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.697062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68072001-caaa-40f8-9fc3-5929ea40f314 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.701779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.702623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.702909 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.703178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.703858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.705747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.732377 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1434/2850] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:34 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:34.736682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.747275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8369c-a7c6-4ba9-bee0-97c3b8cbe762 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.773855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:34.806441 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.807108 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.807390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.807697 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.808314 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.810217 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.831917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1417/2851] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:34 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:34.836057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.846261 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e046cc-5e68-472d-9875-bdec94b352e3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.851502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.852295 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.852579 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.852858 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.853496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.855083 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.865475 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1435/2852] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:34.869935 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.880133 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f3363-3510-4a7c-a603-ed9b794b7456 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.884948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.885571 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.885855 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.886129 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.886766 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.888402 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf7417-c92f-40cc-b020-c8cd507c2177 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.899534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1418/2853] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:34.903844 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:34.914477 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829d526-4e55-41c6-a913-7e62d9aee870 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:34.919266 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:34.919959 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:34.920239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:34.920517 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] PATH_INFO: `/v3/projects/96d87b65cee547d8a12483ce04a60310/users/d556a3667cb84ed2b788ece760fb70c7/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:34.935582 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d87b65cee547d8a12483ce04a60310, user_id=d556a3667cb84ed2b788ece760fb70c7, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:34.938240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:34.950941 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1436/2854] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:34 2022] PUT /identity/v3/projects/96d87b65cee547d8a12483ce04a60310/users/d556a3667cb84ed2b788ece760fb70c7/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:35.013827 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.014131 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.014403 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.042030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] MFA Rules not processed for user `d556a3667cb84ed2b788ece760fb70c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:35.043224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:35.107023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1419/2855] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:35.111546 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.178388 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757f9b-1025-48d8-8a35-de741356abb7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.183605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.184230 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.184521 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.184771 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.185446 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.187314 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.214735 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1437/2856] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:35 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:35.218786 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.229917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a741c-e9aa-489f-9b41-4a856db1f89e None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.286913 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.287552 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.287835 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.288110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] PATH_INFO: `/v3/users` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.288939 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.290859 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.311966 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1420/2857] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:35 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:35.315924 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.327188 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e749-9a25-4461-9f66-886ab044ffa3 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.332065 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.332662 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.332938 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.333240 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.333872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.335498 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.345915 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1438/2858] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:35.349918 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.359927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fb2a7c-adf5-4729-9def-aa4b1a190cef admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.364840 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.365509 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.365782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.366073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] PATH_INFO: `/v3/projects/b5ab1891c98348ffb9841a26e934cdee/users/3ea89bfdcbc346e29f04bcaddab02ef6/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.383280 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ab1891c98348ffb9841a26e934cdee, user_id=3ea89bfdcbc346e29f04bcaddab02ef6, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.385930 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.398408 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1421/2859] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:35 2022] PUT /identity/v3/projects/b5ab1891c98348ffb9841a26e934cdee/users/3ea89bfdcbc346e29f04bcaddab02ef6/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:35.402555 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.412463 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329bc59c-c414-4fda-8546-b5bc445d3b87 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.433093 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:35.473073 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.473747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.473980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.474254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.474925 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.477278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d1ea0d-6531-46f9-886f-81cde9b2d541 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.487806 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1439/2860] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:35.491884 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.497284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:35.503799 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21d8e7-b1ec-4e15-badb-5dea16b2a46c admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.509137 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.509785 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.510060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.510329 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] PATH_INFO: `/v3/projects/b5ab1891c98348ffb9841a26e934cdee/users/3ea89bfdcbc346e29f04bcaddab02ef6/roles/1322cdb780e0414da6e3fc27dcbaecf8` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.512320 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ab1891c98348ffb9841a26e934cdee, user_id=3ea89bfdcbc346e29f04bcaddab02ef6, role_id=1322cdb780e0414da6e3fc27dcbaecf8)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.514904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.525829 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1422/2861] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:35 2022] PUT /identity/v3/projects/b5ab1891c98348ffb9841a26e934cdee/users/3ea89bfdcbc346e29f04bcaddab02ef6/roles/1322cdb780e0414da6e3fc27dcbaecf8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:35.535876 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e7b9-f955-4730-9b65-149594309aed None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.536167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e7b9-f955-4730-9b65-149594309aed None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.536447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e7b9-f955-4730-9b65-149594309aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.564536 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-8744e7b9-f955-4730-9b65-149594309aed None None] MFA Rules not processed for user `3ea89bfdcbc346e29f04bcaddab02ef6`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:35.565753 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-8744e7b9-f955-4730-9b65-149594309aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:35.635038 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1440/2862] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:35.645792 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:35.647542 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:35.710276 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3af3ab-6d4d-4844-8785-80075ffab37e admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:35.717452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:35.718212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:35.718487 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:35.718755 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:35.728660 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:35.730088 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efaad3-9ce9-4aaf-83dc-ed38e03e6e9f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:35.739656 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1423/2863] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:37.077942 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e7b9-f955-4730-9b65-149594309aed None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:37.141080 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8744e7b9-f955-4730-9b65-149594309aed None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:37.145728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:37.146350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:37.146623 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:37.146889 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] PATH_INFO: `/v3/users/d556a3667cb84ed2b788ece760fb70c7` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:37.148632 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556a3667cb84ed2b788ece760fb70c7)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:37.150552 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:37.194187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556a3667cb84ed2b788ece760fb70c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.194820 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556a3667cb84ed2b788ece760fb70c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.196255 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556a3667cb84ed2b788ece760fb70c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.197433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:37.204935 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556a3667cb84ed2b788ece760fb70c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.213576 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556a3667cb84ed2b788ece760fb70c7'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.230714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1441/2864] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:37 2022] DELETE /identity/v3/users/d556a3667cb84ed2b788ece760fb70c7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:37.235135 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:37.235634 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:37.235746 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:37.254154 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:37.255268 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:37.318167 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1424/2865] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:37.328545 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:37.329973 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:37.392075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b5ee0-860e-43c5-a57e-648b29bed491 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:37.399817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:37.400431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:37.400709 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:37.400978 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:37.410187 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:37.411652 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:37.421817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1442/2866] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:37.685764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:37.687230 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:37.700087 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0e945-9595-414c-908a-589d271a0a81 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:37.704991 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:37.705623 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:37.705904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:37.706177 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] PATH_INFO: `/v3/projects/96d87b65cee547d8a12483ce04a60310` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:37.707292 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d87b65cee547d8a12483ce04a60310)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:37.709334 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:37.755659 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d87b65cee547d8a12483ce04a60310', 'request_id': 'req-883e2a6e-6c35-480a-bfad-b7aeb98161df'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.762271 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d87b65cee547d8a12483ce04a60310', 'request_id': 'req-883e2a6e-6c35-480a-bfad-b7aeb98161df'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.768049 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d87b65cee547d8a12483ce04a60310', 'request_id': 'req-883e2a6e-6c35-480a-bfad-b7aeb98161df'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.781340 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] The token cache is being invalidate because project 96d87b65cee547d8a12483ce04a60310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:37.781622 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.782232 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.783717 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1425/2867] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:37 2022] DELETE /identity/v3/projects/96d87b65cee547d8a12483ce04a60310 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:37.787779 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:37.798020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5276b4-c670-4058-b42a-8650842849b4 service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:37.855035 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:37.855699 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:37.855982 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:37.856258 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] PATH_INFO: `/v3/users/3ea89bfdcbc346e29f04bcaddab02ef6` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:37.857370 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea89bfdcbc346e29f04bcaddab02ef6)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:37.859272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:37.904605 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea89bfdcbc346e29f04bcaddab02ef6'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.905256 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea89bfdcbc346e29f04bcaddab02ef6'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.905866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea89bfdcbc346e29f04bcaddab02ef6'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.912714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea89bfdcbc346e29f04bcaddab02ef6'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.921541 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-0ffde2cf-3b2c-4918-b3f5-0b235f28e148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea89bfdcbc346e29f04bcaddab02ef6'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:37.926914 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:37.941239 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1443/2868] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:37 2022] DELETE /identity/v3/users/3ea89bfdcbc346e29f04bcaddab02ef6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:08:38.469720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.471275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:38.499452 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e2a6e-6c35-480a-bfad-b7aeb98161df admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.513270 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:38.561394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.562023 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.562300 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.562570 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] PATH_INFO: `/v3/projects/b5ab1891c98348ffb9841a26e934cdee` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.563709 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ab1891c98348ffb9841a26e934cdee)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:38.565597 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:38.610959 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ab1891c98348ffb9841a26e934cdee', 'request_id': 'req-855543d7-0824-4167-b4ef-dbc5cc45e28a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:38.617682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ab1891c98348ffb9841a26e934cdee', 'request_id': 'req-855543d7-0824-4167-b4ef-dbc5cc45e28a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:38.623182 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ab1891c98348ffb9841a26e934cdee', 'request_id': 'req-855543d7-0824-4167-b4ef-dbc5cc45e28a'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:38.634779 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] The token cache is being invalidate because project b5ab1891c98348ffb9841a26e934cdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:38.635065 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:38.635720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-855543d7-0824-4167-b4ef-dbc5cc45e28a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:38.637183 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1426/2869] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:38 2022] DELETE /identity/v3/projects/b5ab1891c98348ffb9841a26e934cdee => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:38.642029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.642506 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.642646 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.661922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:38.663126 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:38.723194 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1444/2870] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:08:38.732951 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.733251 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.733501 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.752606 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:38.753797 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:38.762058 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1427/2871] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:38.766300 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.776695 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b49e-ad8b-4da7-a391-b968e4733854 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.781275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.781872 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.782151 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.782424 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.783068 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:08:38.783374 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:38.785027 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:38.797740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1445/2872] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 05:08:38.801714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.811297 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160519-be34-449e-a4fc-24bba195a546 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.815898 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.816484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.816760 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.817032 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.817654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:38.819628 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:38.848220 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1428/2873] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:38.852951 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.863805 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8b1d-8e3e-4f7c-86e0-b01f9b57ce00 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.920409 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.921014 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.921282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.921553 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.922154 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:38.924087 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:38.944135 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1446/2874] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:38 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:38.948500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.959025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472d343-7043-42ad-8e86-5c100b241ca0 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.964205 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.964795 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.965076 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.965350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.965983 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:38.967610 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:38.978103 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1429/2875] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:38.982122 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:38.992103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628d31a-71f1-4979-a587-4798e82e1658 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:38.996686 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:38.997278 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:38.997557 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:38.997830 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:38.998469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.000085 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0b321-513b-4e0d-a35b-f0685cfd0791 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.010568 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1447/2876] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:39.014551 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:39.024943 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631c94f-77bc-488e-9862-e017e82bd8f2 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:39.029461 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:39.030094 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.030370 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.030641 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] PATH_INFO: `/v3/projects/4ccdc5de33bc45a68dc72eb8eb9c882f/users/de9024e1298749fcbaf8a0f935ac764a/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.046252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccdc5de33bc45a68dc72eb8eb9c882f, user_id=de9024e1298749fcbaf8a0f935ac764a, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.049210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.061389 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1430/2877] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:39 2022] PUT /identity/v3/projects/4ccdc5de33bc45a68dc72eb8eb9c882f/users/de9024e1298749fcbaf8a0f935ac764a/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:08:39.072357 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c269048-e018-4034-961b-85ad4552a600 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.072644 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c269048-e018-4034-961b-85ad4552a600 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.072920 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c269048-e018-4034-961b-85ad4552a600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.100848 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6c269048-e018-4034-961b-85ad4552a600 None None] MFA Rules not processed for user `de9024e1298749fcbaf8a0f935ac764a`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:39.102356 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6c269048-e018-4034-961b-85ad4552a600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:39.143045 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:39.167817 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1448/2878] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:39.179128 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:39.180917 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:39.227060 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:39.240206 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a4a40-ec9a-4fde-a162-49252c571339 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:39.243900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:39.244494 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.244773 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.245043 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.253277 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.254683 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69d3c1-405d-4159-8555-75735ab28f42 service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.264396 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1431/2879] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:39 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:39.284001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c269048-e018-4034-961b-85ad4552a600 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:39.347563 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c269048-e018-4034-961b-85ad4552a600 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:39.352272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:39.352892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.353163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.353427 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] PATH_INFO: `/v3/users/de9024e1298749fcbaf8a0f935ac764a` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.354539 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] RBAC: Authorizing `identity:delete_user(user_id=de9024e1298749fcbaf8a0f935ac764a)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.356469 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.402376 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de9024e1298749fcbaf8a0f935ac764a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.402958 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de9024e1298749fcbaf8a0f935ac764a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.403592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de9024e1298749fcbaf8a0f935ac764a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.410309 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de9024e1298749fcbaf8a0f935ac764a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.417589 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de9024e1298749fcbaf8a0f935ac764a'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.436212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1449/2880] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:08:39 2022] DELETE /identity/v3/users/de9024e1298749fcbaf8a0f935ac764a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:39.440584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.440869 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.441143 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.461761 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:39.462969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:39.522000 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1432/2881] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:39.531747 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:39.533167 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:39.590451 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c346c80-424b-4ed2-994b-d5bef120704c admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:39.594129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:39.594727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.595011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.595282 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.604351 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.605759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af08adf-543b-4837-ac65-8a320ea405bf service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.614992 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1450/2882] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:39.896025 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:39.897546 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:39.909747 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9e432-95ab-4450-838f-fe0c248fbff1 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:39.915057 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:39.915648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:39.915929 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:39.916203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] PATH_INFO: `/v3/projects/4ccdc5de33bc45a68dc72eb8eb9c882f` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:39.917332 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccdc5de33bc45a68dc72eb8eb9c882f)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:39.919305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:39.967189 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccdc5de33bc45a68dc72eb8eb9c882f', 'request_id': 'req-e3e67dd6-ffe6-4547-9d80-13759cf7e632'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.973275 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccdc5de33bc45a68dc72eb8eb9c882f', 'request_id': 'req-e3e67dd6-ffe6-4547-9d80-13759cf7e632'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.979553 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccdc5de33bc45a68dc72eb8eb9c882f', 'request_id': 'req-e3e67dd6-ffe6-4547-9d80-13759cf7e632'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.991407 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] The token cache is being invalidate because project 4ccdc5de33bc45a68dc72eb8eb9c882f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81491) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:08:39.991720 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.993305 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-e3e67dd6-ffe6-4547-9d80-13759cf7e632 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:08:39.994765 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1433/2883] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:08:39 2022] DELETE /identity/v3/projects/4ccdc5de33bc45a68dc72eb8eb9c882f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:40.000690 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.001203 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.001478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.010447 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:40.022496 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:40.024263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:40.086936 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1451/2884] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:40.094669 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.094955 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.095231 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.115254 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:40.116502 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:40.125030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1434/2885] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:40.129257 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.139433 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580a455-497f-4089-8e6a-ec5d46f20782 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.144041 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.144641 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.144919 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.145190 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.145834 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81490) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 05:08:40.146137 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.147790 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.159522 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1452/2886] 10.222.0.85 () {58 vars in 1153 bytes} [Wed Aug 24 05:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 05:08:40.164224 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.173390 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8a15ae-c5f8-4348-9bed-12565c38c4d5 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.178174 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.178915 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.179195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.179612 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] PATH_INFO: `/v3/projects` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.180443 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.182373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.211330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1435/2887] 10.222.0.85 () {60 vars in 1153 bytes} [Wed Aug 24 05:08:40 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 05:08:40.215450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.225315 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0db9ab-7b2c-4454-9223-832040b06d8e admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.282350 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.282957 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.283244 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.283548 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.284178 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.286103 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.306980 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1453/2888] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Aug 24 05:08:40 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 05:08:40.311089 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.321284 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7b0f1-4683-4f5f-988b-0e56ee28c34a admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.325846 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.326436 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.326714 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.326987 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.327655 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.329491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.339678 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1436/2889] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:40.347836 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.364730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876c674-07e7-48a7-9553-05779fbf8ad7 admin admin] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.370892 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.371592 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.371866 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.372267 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] PATH_INFO: `/v3/roles` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.372913 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.374502 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e3e94-d54d-4c57-bb16-867015b1077c admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.385865 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1454/2890] 10.222.0.85 () {58 vars in 1122 bytes} [Wed Aug 24 05:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 05:08:40.390042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.400741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275217c-46d6-4686-92d0-37296b987efe admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.405380 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.406018 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.406298 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.406573 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] PATH_INFO: `/v3/projects/b302be2024b24e39af7c38a24a959046/users/b7c53f82dd9e46639b0788efece9a9f9/roles/97c92764f4f344c5a16b60e86473677d` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.421330 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b302be2024b24e39af7c38a24a959046, user_id=b7c53f82dd9e46639b0788efece9a9f9, role_id=97c92764f4f344c5a16b60e86473677d)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.424067 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.437083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1437/2891] 10.222.0.85 () {60 vars in 1483 bytes} [Wed Aug 24 05:08:40 2022] PUT /identity/v3/projects/b302be2024b24e39af7c38a24a959046/users/b7c53f82dd9e46639b0788efece9a9f9/roles/97c92764f4f344c5a16b60e86473677d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:08:40.442358 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839ce6-99ac-4ded-ae60-2ddbe8c18724 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.442659 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839ce6-99ac-4ded-ae60-2ddbe8c18724 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.442928 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6839ce6-99ac-4ded-ae60-2ddbe8c18724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.463020 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e6839ce6-99ac-4ded-ae60-2ddbe8c18724 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:40.464275 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e6839ce6-99ac-4ded-ae60-2ddbe8c18724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:40.523730 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1455/2892] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 05:08:40.535073 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:40.536820 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:40.544210 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:40.596212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdb7d1-49a8-434a-9f9b-457984c99ec8 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:40.599782 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:40.600373 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:40.600648 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:40.600919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:40.609702 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:40.611102 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:40.620543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1438/2893] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:41.238660 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0a6a-cbac-4380-8a46-f16accad395d None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:41.239193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0a6a-cbac-4380-8a46-f16accad395d None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:41.239193 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb0a6a-cbac-4380-8a46-f16accad395d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:41.261303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:08:41.269740 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-e1eb0a6a-cbac-4380-8a46-f16accad395d None None] MFA Rules not processed for user `b7c53f82dd9e46639b0788efece9a9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:41.271631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-e1eb0a6a-cbac-4380-8a46-f16accad395d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:41.341598 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1456/2894] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:41.352847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:41.354361 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:41.415584 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050588a0-a4e5-4fea-9955-a4ff607900d6 service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:41.420635 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b6d6e1beae43fab3e5b1a32447540c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:41.421252 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:41.421530 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:41.421807 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:41.431516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:41.432936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:41.442975 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1439/2895] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:42.791023 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:42.791604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:42.791604 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:42.812069 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] MFA Rules not processed for user `b7c53f82dd9e46639b0788efece9a9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:08:42.813289 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:42.820242 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1457/2896] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:08:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:08:43.058613 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:43.060110 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:43.072160 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d0ac4-f8e7-49bc-8ec2-9d40b14ada5f service cinder] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:43.075803 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:43.076394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:43.076676 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:43.076950 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:43.078889 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:43.089075 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:43.090476 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a355bff-447b-4ba4-9f9b-2bd174161d52 service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:43.098607 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1440/2897] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:51.497042 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:08:51.507624 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c3e715-9c78-4f02-b7cc-20d30819b2e1 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:08:51.512029 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:08:51.512631 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:08:51.512907 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:08:51.513177 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:08:51.514894 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:08:51.585997 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:08:51.588067 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:08:51.598877 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1458/2898] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:08:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:08:53.095030 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=56 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:01.594062 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=64 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:14.319212 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efa01-0ccf-4850-93e2-e543b7323e7f None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:14.319812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efa01-0ccf-4850-93e2-e543b7323e7f None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:14.319812 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519efa01-0ccf-4850-93e2-e543b7323e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:14.339817 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-519efa01-0ccf-4850-93e2-e543b7323e7f None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:14.341019 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-519efa01-0ccf-4850-93e2-e543b7323e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:14.348813 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1441/2899] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:14.372603 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:14.374129 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:14.388852 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a92b4-3722-4b55-afdf-596edf80e70a service neutron] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:14.394327 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:14.394922 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:14.395201 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:14.395510 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:14.403703 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:14.405263 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:14.414610 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1459/2900] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:09:18.398027 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe925f-04fd-44ed-bb65-cbbf02b59f87 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:18.398575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe925f-04fd-44ed-bb65-cbbf02b59f87 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:18.398575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe925f-04fd-44ed-bb65-cbbf02b59f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:18.417764 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-febe925f-04fd-44ed-bb65-cbbf02b59f87 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:18.418960 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-febe925f-04fd-44ed-bb65-cbbf02b59f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:18.426793 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1442/2901] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:18.456375 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:18.469192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85edf44a-6f8f-4358-9135-1f33c94da762 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:18.475455 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:18.476148 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:18.476450 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:18.476774 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:18.486442 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:18.488111 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:18.497714 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1460/2902] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:21.677044 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73a5ea-e755-4819-91ac-3bcf20f0b8a4 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:21.677484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73a5ea-e755-4819-91ac-3bcf20f0b8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:21.677596 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc73a5ea-e755-4819-91ac-3bcf20f0b8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:21.697117 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-bc73a5ea-e755-4819-91ac-3bcf20f0b8a4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:21.698315 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-bc73a5ea-e755-4819-91ac-3bcf20f0b8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:21.706871 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1443/2903] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:21.727761 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:21.739818 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17391f7a-82fc-47d4-b83c-e7dff565a9fb service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:21.745325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:21.745916 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:21.746196 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:21.746466 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:21.754591 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:21.756192 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:21.765675 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1461/2904] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:24.747050 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63204-cc3b-4f1b-9be8-f0f4f78b505e None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:24.747575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63204-cc3b-4f1b-9be8-f0f4f78b505e None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:24.747575 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f63204-cc3b-4f1b-9be8-f0f4f78b505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:24.767009 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-09f63204-cc3b-4f1b-9be8-f0f4f78b505e None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:24.768226 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-09f63204-cc3b-4f1b-9be8-f0f4f78b505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:24.775948 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1444/2905] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:24.797759 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:24.809622 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1c35d-9955-4eaf-af9e-c12cef09730a service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:24.815152 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:24.815815 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:24.816094 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:24.816367 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:24.825453 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:24.827012 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:24.836741 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1462/2906] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:28.935262 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813826d-2533-4e79-b080-93cdc6082ad1 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:28.935890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813826d-2533-4e79-b080-93cdc6082ad1 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:28.935890 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813826d-2533-4e79-b080-93cdc6082ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:28.956654 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-a813826d-2533-4e79-b080-93cdc6082ad1 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:28.957849 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-a813826d-2533-4e79-b080-93cdc6082ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:28.966528 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1445/2907] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:29.019057 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:29.033728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79a27-bb88-46c6-9eaa-25a90b56b549 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:29.040043 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:29.040666 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:29.040944 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:29.041211 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:29.050163 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:29.052833 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:29.062414 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1463/2908] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:33.130289 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] REQUEST_METHOD: `POST` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:33.130903 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:33.131053 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:33.150843 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.auth.core [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81491) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:33.152343 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:33.161238 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1446/2909] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:33.180899 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:33.191939 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a90c0-a85e-48c2-ac48-fd70a123e123 service nova] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:33.197672 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:33.198254 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:33.198525 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:33.198789 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:33.207074 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:33.209249 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931eed82-697f-45ea-af57-faba0a86314c service nova] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:33.218728 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1464/2910] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:43.038649 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:43.053529 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1827f-520e-488b-8d25-a40a117ce784 None None] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:43.059195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:43.059865 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:43.060138 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:43.060400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:43.062335 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:43.076831 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:43.078397 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:43.090304 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1447/2911] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:43.214607 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=36 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:48.225175 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952de7-f44d-48b5-90c0-9810676db676 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:48.225819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952de7-f44d-48b5-90c0-9810676db676 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:48.225819 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b952de7-f44d-48b5-90c0-9810676db676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:48.245260 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-6b952de7-f44d-48b5-90c0-9810676db676 None None] MFA Rules not processed for user `b7c53f82dd9e46639b0788efece9a9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:09:48.246483 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-6b952de7-f44d-48b5-90c0-9810676db676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:48.253303 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1465/2912] 10.222.0.85 () {58 vars in 958 bytes} [Wed Aug 24 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:09:50.426904 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:09:50.431531 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=25 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:09:50.437919 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47371386-b21e-49cc-8917-eb2ee61cc436 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:09:50.441525 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8753ed696f8d4cffb71475a945778e80', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:09:50.442120 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:09:50.442400 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:09:50.442673 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:09:50.444523 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:09:50.454295 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:09:50.455738 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:09:50.464740 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1448/2913] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:09:58.239783 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=3 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:00.461080 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=5 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:02.041478 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9427-8354-4dff-9cc5-21f325a259e7 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:02.042091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9427-8354-4dff-9cc5-21f325a259e7 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:02.042091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea9427-8354-4dff-9cc5-21f325a259e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:02.063251 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-97ea9427-8354-4dff-9cc5-21f325a259e7 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:10:02.064500 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-97ea9427-8354-4dff-9cc5-21f325a259e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:02.072268 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1466/2914] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:10:02.091936 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:02.105363 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f722bc9-6402-491e-b32f-04f28699676c service neutron] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:02.110816 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:02.111401 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:02.111708 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:02.111978 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:02.120682 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:02.122227 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:02.131499 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1449/2915] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:05.291643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae792d3a-77b0-4600-a488-2afd20e8c170 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:05.291643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae792d3a-77b0-4600-a488-2afd20e8c170 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:05.291643 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae792d3a-77b0-4600-a488-2afd20e8c170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:05.315001 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-ae792d3a-77b0-4600-a488-2afd20e8c170 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:10:05.316264 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-ae792d3a-77b0-4600-a488-2afd20e8c170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:05.324995 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1467/2916] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:10:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:10:05.343484 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:05.355693 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5cd6-512e-4199-b0f3-62805a75a82f service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:05.361261 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:05.361851 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:05.362126 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:05.362394 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:05.371979 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:05.373534 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:05.383743 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1450/2917] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:08.384339 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0029d-5d53-4a0a-85c7-2c3ad46bdfcd None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:08.384846 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0029d-5d53-4a0a-85c7-2c3ad46bdfcd None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:08.384966 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0029d-5d53-4a0a-85c7-2c3ad46bdfcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:08.404031 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-9ef0029d-5d53-4a0a-85c7-2c3ad46bdfcd None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:10:08.405238 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-9ef0029d-5d53-4a0a-85c7-2c3ad46bdfcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:08.413089 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1468/2918] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:10:08.433957 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:08.445806 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f186532-de93-4a5e-b60f-49b63ebe7a07 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:08.451307 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:08.451938 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:08.452242 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:08.452516 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:08.461324 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:08.462886 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:08.472434 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1451/2919] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:12.573687 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d317e6-ed75-4c9f-9e33-2cb20dd752c4 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:12.574212 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d317e6-ed75-4c9f-9e33-2cb20dd752c4 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:12.574328 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d317e6-ed75-4c9f-9e33-2cb20dd752c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:12.594112 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-73d317e6-ed75-4c9f-9e33-2cb20dd752c4 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:10:12.595312 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-73d317e6-ed75-4c9f-9e33-2cb20dd752c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:12.603091 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1469/2920] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:10:12.650228 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:12.661701 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee33a3-55de-4613-bde9-8eed6a82a3c5 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:12.667429 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:12.668042 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:12.668322 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:12.668594 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:12.676696 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:12.678263 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:12.688497 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1452/2921] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 05:10:16.759776 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] REQUEST_METHOD: `POST` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:16.760272 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:16.760431 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:16.779948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.auth.core [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] MFA Rules not processed for user `45426782369b4a9484d272e822de6396`. Rule list: `[]` (Enabled: `True`). {{(pid=81490) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 05:10:16.781157 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:16.788984 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1470/2922] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 05:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 05:10:16.810647 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:16.822235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4752c-8f11-4f07-8554-1bb1f77fec61 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:16.828900 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '640768a362f64590b7cc779353b02b6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:16.829503 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:16.829969 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:16.830473 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:16.840736 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:16.842311 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:16.852774 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1453/2923] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:26.775224 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=15 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:26.847741 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=30 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:46.699742 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:46.701182 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:46.769533 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:46.779821 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c28229-95f2-444e-860a-1f42fe9c82f1 service nova] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:46.784366 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:46.785111 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:46.785557 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:46.786083 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] PATH_INFO: `/v3/users/b7c53f82dd9e46639b0788efece9a9f9` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:46.787203 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c53f82dd9e46639b0788efece9a9f9)` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:46.789243 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:46.798011 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c52b2c-0143-4ce8-b8b9-ab53c0242e36 None None] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:46.808880 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:46.809727 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] REQUEST_METHOD: `GET` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:46.810075 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:46.810551 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:46.812795 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.fernet_utils [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81490) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:10:46.829108 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:46.832104 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:46.846247 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1471/2924] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:10:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:10:46.847489 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c53f82dd9e46639b0788efece9a9f9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:46.848180 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c53f82dd9e46639b0788efece9a9f9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:46.857500 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c53f82dd9e46639b0788efece9a9f9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:46.858431 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c53f82dd9e46639b0788efece9a9f9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:46.866437 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.notifications [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c53f82dd9e46639b0788efece9a9f9'} {{(pid=81491) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:46.884194 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1454/2925] 10.222.0.85 () {58 vars in 1224 bytes} [Wed Aug 24 05:10:46 2022] DELETE /identity/v3/users/b7c53f82dd9e46639b0788efece9a9f9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 05:10:47.056325 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] Authenticating user token {{(pid=81490) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:10:47.070232 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc73f0b-484c-455d-89be-367067593f99 service placement] Validating token access rules against request {{(pid=81490) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:10:47.130882 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45426782369b4a9484d272e822de6396', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa9562368e9a4def85d52ce0d60bc9dc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81490) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:10:47.131550 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:10:47.131948 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:10:47.132222 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] PATH_INFO: `/v3/projects/b302be2024b24e39af7c38a24a959046` {{(pid=81490) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:10:47.133331 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b302be2024b24e39af7c38a24a959046)` {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:10:47.135368 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] RBAC: Authorization granted {{(pid=81490) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:10:47.180970 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b302be2024b24e39af7c38a24a959046', 'request_id': 'req-3ee44169-1f2d-4abd-9d25-1480a9ff1661'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:47.186608 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b302be2024b24e39af7c38a24a959046', 'request_id': 'req-3ee44169-1f2d-4abd-9d25-1480a9ff1661'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:47.193816 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b302be2024b24e39af7c38a24a959046', 'request_id': 'req-3ee44169-1f2d-4abd-9d25-1480a9ff1661'} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:47.205560 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] The token cache is being invalidate because project b302be2024b24e39af7c38a24a959046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81490) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 05:10:47.205851 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:47.206486 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG keystone.notifications [None req-3ee44169-1f2d-4abd-9d25-1480a9ff1661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81490) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 05:10:47.207998 dv-cinder-854266-1-smb devstack@keystone.service[81490]: [pid: 81490|app: 0|req: 1472/2926] 10.222.0.85 () {58 vars in 1233 bytes} [Wed Aug 24 05:10:47 2022] DELETE /identity/v3/projects/b302be2024b24e39af7c38a24a959046 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 05:10:56.880591 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:10:57.202007 dv-cinder-854266-1-smb devstack@keystone.service[81490]: DEBUG dbcounter [-] [81490] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81490) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 05:12:57.866927 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Authenticating user token {{(pid=81491) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 05:12:57.868543 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:12:58.005780 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b85df-b300-4634-a9c6-9ef5333a19e1 admin admin] Validating token access rules against request {{(pid=81491) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 05:12:58.063350 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f1af6c98265e44eab90317693fb7f1b2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9f70d413dd75492aac987cc32f144d52', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81491) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 05:12:58.063912 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] REQUEST_METHOD: `GET` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 05:12:58.064195 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] SCRIPT_NAME: `/identity` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 05:12:58.064491 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81491) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 05:12:58.066253 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.fernet_utils [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81491) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 05:12:58.079235 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 05:12:58.080894 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3b701-cce2-40e4-81d2-5b806b1d8de2 service placement] RBAC: Authorization granted {{(pid=81491) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 05:12:58.092171 dv-cinder-854266-1-smb devstack@keystone.service[81491]: [pid: 81491|app: 0|req: 1455/2927] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Aug 24 05:12:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 05:13:08.086847 dv-cinder-854266-1-smb devstack@keystone.service[81491]: DEBUG dbcounter [-] [81491] Writing DB stats keystone:SELECT=89 {{(pid=81491) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}